He better play his cards perfectly to prevent this from happening

Collector: there are plenty of ways you could do that, for example make it so your staff rejects anyone who isn't worthy.

For example to be worthy you would use the staff to protect your people, not because you crave power