That's true of most diseases, but we still like to push the mortality numbers down, because those numbers represent people. The difference between a 1% and .5% mortality on a global level, even if only half of the global population gets infected, is in the tens of millions. (8 Billion x 1/2 = 4 B; 4 B x .01 = 40 million, whereas x .005 = 20 million).
If the jab can save tens of millions of lives, it's worth it. But that's my perspective. If you have an argument about why those lives are not worth the effort . . . feel free to make it.