It isn't really about what they say. They have the right to say the things they say. The problem is the hypocrisy.
I don't watch the view so I don't know everything that is said on there, but I'm sure they aren't saying anything racist. Although, if they are, then the hypocrisy is relevant.