You need to study your history and apply a little logic . Only 5 to 6% of southerners owned slaves. Out of the rest of the population who didn't, who in their right senses would have fought and died for a minority's right to own slaves?
I know that this was only a military flag. There were 3 different National flags of the Confederacy. The 3rd being a white flag with a battle flag field, with a red bar added at the end to distinguish thw white part from a flag of truce.