Actually, it most often–and this is true for Christians as well–arises from influence by other atheist figures at a young age. It's almost impossible to not indoctrinate the children, and atheists and Christians aren't exactly trying not to.
Often, people hold their views out of ignorance of every other view.