You just explained that he wasn't and they had the audacity to say that... I hope you're okay. Some people can be really dumb and insensitive when it comes to things like this.
Yeah, I get that. If anyone says something rude, I'd recommend blocking them. It's not worth getting upset over, especially since they're just being an asshole.