We all do things that are less than ideal. But that doesn't make us any less of a person, and you'd do well to remember that.
Believe me, I spent a large majority of my life holding in my pain too. I was scared to hurt people, same as you
Sometimes I still do hold in a bit of my pain, but I channel it productively (anger for exercise or cleaning for example, and sadness for art).