I'll make the argument that looking like a male or a female does not confirm the gender. If one has the "equipment" to provide sperm to the uterus, then he is a man, and if one has the "equipment" to receive sperm in the uterus, then she is a woman. Similarly, if one has milk glands in the upper-torso, she is a woman, and if not, he is a man.