You're not, trust me, I've seen people far more toxic than you supposedly are, he's just angry because he's overly attached to anime and can't accept the truth.
Nobody actually watches anime 24/7, though many weeaboos do binge watch anime for unhealthy amounts of time. Also, anyone who matches anime is considered a weeaboo by us.