I'll tell you if you're right

What I'm afraid of

Government?

Hmm no.

Samurai?

no, they're easy to kill if you aren't an idiot about it.

Samurai are not easy to kill mate. You're an assassin part of a long line of a family of special forces you're supposed to kill political leaders and other high ranking officials not meet samurai in the field of battle

Exactly what I just said. Meeting a trained warrior in combat would be idiotic. Shinobi prefer to work with poison, not blades.

Sorry, misread your previous comment. You would most likely fear another Shinobi.

Closer.
What I really fear, is the weakness within myself that grows with age. Someday I will fail to escape, and when that happens, I will end.

I mean could be "assassinated" and go into hiding.

Not really. I actually work with numbers.

You should try it. I'm going to recommend you to a gardening method called Permaculture (mimics nature and no rules).

https://youtu.be/ejMHuRzYlmE

https://youtu.be/hCJfSYZqZ0Y

Not how I work. Anarchy isn't for the money, it's for the ideals.

Ever tried gardening?