Right, you shouldn't outright ignore the suggestions to wear a mask just because a few may not be capable of wearing them. Of course there are some exceptions to the rule but there are people who are saying the following;
1. Wearing a mask is submission
No, it's a courtesy.
2. Masks do more harm than good
No, masks do more good than harm.
3. Wearing a mask for a long period of time is not safe
No, wearing the same N95 mask day after day is potentially not safe. The same is not said of the medical masks, especially the rewashable cotton ones which while may not offer you prime protection they prevent the spread of the virus.
4. Masks don't prevent the spreading of viruses because they are tinier than the fibers of the mask
No, wearing a mask does prevent the spread of the virus because it's primary mode of transportation is on water droplets expelled by the nose and mouth which is why it's recommended you wear the mask.
No one is advocating staying at home 24/7.. but limiting how often you go out. Ideally, you would be home for 2 weeks but if you have to work, need essential supplies (and can get them), or medical attention then sure, go out.
And you shouldn't be wearing the mask 24/7 either. If you're going out in public, where there may be other people you're not usually exposed to, wear a mask if you can. You don't have to wear it when you go outside, and there is no one there, or in your car, or in your own home. That would be pretty stupid.
But if you come into contact with multiple people, many hours of the day, then you probably should be wearing a mask.