I’m just explaining how your joke probably came across to others. Not everyone has genitals that match how they choose to identify and reducing someone to what is in their pants can be seen as insensitive toward transgender, nonbinary & genderfluid people.