Some transgender people will just call you transphobic for not agreeing with them or not being sexually/romantically attracted to them. I deal with this shit all the time in the HP fandom. There accusations have no base since you've never said anything of the sort.