I don't see why he'd backtrack on anything.
If someone moves into your spare room and spends every waking moment saying how bad everything is and gating on everything you have, you tell them to pack their bags and eff-off... But somehow that's racist?
Who even cares. If he so much as looked at her wrong they'd call him racist anyway, so what does it matter..