Not necessarily "tons" of wives, but the commonly held belief is that they are able to marry more than one. One man marrying two wives makes an odd number of married people.
Don't get me wrong, I'm not against Mormons, but they are the most recognizable group that would make the math work. :-)