I’ve thought about this all day and here is my theory anyway
This appears at first glance to be anti-male sexism but it is actually a subtle manifestation of anti-female sexism
Because
Traditionally “male” clothing is viewed as inherently superior and more serious, therefore women can adopt it without problems and even benefit as a result.
However, “female” clothing is viewed as inferior and sissy and therefore calls a man’s masculinity into question when it’s worn by men. This limits the choices of men but it’s actually because masculinity is privileged.