Atheist right of center libertarian here. It's more that both groups have ideologies that lead them to illogical thinking.
On the right it's religion, on the left it's social justice. Both have their outgroups, their nebulous threats and promises and contradictory rules and mindsets.
If you're an atheist, then it's more deciding which ideology is the more dangerous one and for me that's clearly the left-wing ideology. Christianity had its teeth pulled a long time ago, but social justice's malevolence is only just experiencing a first backlash.