It's a crass analogy but it works really well:
Imagine for a moment that you're out in public and a strange gentleman you do not know urinates onto your legs.
Obviously, it helps that you are wearing pants at that moment, because it would definitely be worse if he were peeing onto your bare skin. But in that moment, don't you wish that he was the one wearing pants properly and keeping them on?
That's why it's your responsibility to wear a mask. You could be the one peeing on other people and not even know it.