Look up the clip where he said that. Right before it he explicitly condemned the white supremacists. The "very fine people" was referring to both the people who wanted the statue to stay for historical reasons and the people who wanted it gone.
The second thing referred to him stating that Black conservatives supported him because he's been specially discriminated against in the system. Which is accurate - there are many cases of the law discriminating against Black people. I think denying that is more racist, actually.
Also, calling a nation a "shithole" is not inherently racist. If he blamed the people who lived there for it, that would be. And have you even been to Haiti? It's not great.
