Yeah, good point. That's why I'm not that authoritarian. Power can fall into the wrong hands too easily.
No matter what good changes are done, thing can end up undone. I believe in democracy. And having it set up so power doesn't fall into the "wrong" hands would most likely go against what I believe.
It's not hopeless, though. I believe there's almost always another way.