Well, I disagree with your premise -- even if you've never had a conversation with a black person in your life, I still think you can exercise your imaginative and compassionate sense to put yourself in their shoes.
Example: I've never spoken directly with, say, a Tibetan or Uighur, and yet all I have to do is read the headlines to know that they're struggling under oppression by the Chinese state. I don't have to first have a conversation in order to have an opinion.