I haven't seen every other atheist appear immoral to one another. A lot of atheists are friendly to each other more than half of the time.
If anything, a lot of Christians and Muslims judge others of their community as immoral, hence calling one another "not Christian", or "not Muslim", etc.
Now if atheists are seen as immoral, I can get that, but it's rarely from other atheists. Atheists being seen as immoral is usually a habit among religious individuals trying to hide their fear that there is someone who isn't scared of a diety.