It's only racist if you think saying literally /anything/ insulting towards a black person is racist. And if you honestly think that, you're doing nothing but White Knighting.
"Neanderthal" is in fact NOT a racist insult, at least not against black people, it's an insult common to both ugly men of /any/ race, and to any men who behave in a boorish or brutish manner. And as RedBarron pointed out, the neanderthal gene comes from outside of Africa, so it's an insult to the part of his genetic makeup that /isn't/ black.
Caption this Meme
