You're engaging in fallacy. Jefferson chose his words wisely with forethought to the future. "Men" in this instance, was thought by most go mean "of class". He knew it would include men of different classes, races, and religious affiliation. He also would have noted. Because he mentions it elsewhere, that " men" would eventually be argued to envelope mankind which includes women and children.
