Personally I don't care if they use the men's room, as that can never become a threat. Just like no one really cares when a woman uses the men's room.
Locker rooms are different for people though, and concern for the many weighs higher to me than concern for the very.. very few
