Communism and Atheism are different. Communism is the idea that all things belong to the government, and it's their responsibility to provide it to the people (and look how that turned out). However, Communism can't exist with a dominant religion (especially Christianity), because that would mean believing in something which isn't the state.
Atheism is just not believing in a god.