Technically speaking, the gender non-conformists were born gender non-conforming because of brain structure. However, in most cases, it would take them up until their teenage to adult years for them to realize.
Honestly, there is no harm in being gender non-conforming; everyone should just be themselves. I wonder if the anti-LGBTQ activists will eventually realize that.