Christians and 'Polytheists' are ones cursed by the Prophet as well. The most Muslim hating people I've ever come across on the web, are Hindus (polytheists).
I'm Atheist and I imagine that we only confuse them, since we aren't mentioned specifically other than just being part of the horrible nonbelievers, which are ofc everyone else but Muslims