All these responses miss one thing: The government can't take away your rights no matter what they are. They can only protect your rights and the rights of others.
It is actually unconstitutional for the federal government to require drivers licenses on roads unless those roads cross state lines and then they can only legally enforce it on those that are travelling between states.
That's why each state issues its own drivers license and they are all different.
Laws that require you to wear seat belts are unconstitutional, but the laws that allow arrests of 'reckless' drivers are constitutional.
In the case of wearing a mask, the government would have to prove that you are dangerous to others. So after they arrest you they would give you a covid-19 test and then if you test positive, they could prosecute you for reckless endangerment. If you test negative they have to drop the case.
Of course very few judges and district attorney's actually follow the constitution which is why every one of Trumps 100% legal executive orders are blocked by a judge somewhere.
Here's what people should do practically if you fear covid-19, you wear a mask and take the precautions. That will keep you safe. The rest of us will do what we thing will keep us safe. If someone gets you sick, sue them for reckless endangerment.