His “you ain’t black” comments were cringe, but Trump supporters were not well-positioned to complain about it to say the least