This might sound homophobic, but I'm just speaking scientifically. (I'm bisexual btw)
Clothes fit differently on people that have the biological sex of men or women. So since sex and gender are different, you can identify as a different gender while still wearing clothes that more comfortably fit you. This is still a screw-up on their part, but scientifically speaking this kind of makes sense
