1. hate to be that guy (*voice in the distance* no you don't!) but it's "sexist"
2. don't worry, the joke didn't contain an insult, so you should be fine (hard to tell with certain people, which is why it made sense you were worried, but it's a good rule of thumb)