No, you're absolutely correct: the highest desertion rates any army has seen in United States history was the confederate army. Their cause was not supported by the morale of their own men at all.
Neo-confederates don't like that historical nugget of information because it disrupts their Lost Cause narrative.