Yes. Because, in a sentence, I did not need to refer to you as sir. Because the sentence did not require it. Now, if I’m talking about you to someone else, I would say “sir said blahblahblah” in replace of your name. That is how pronouns work. I don’t have to add it into the sentence if it doesn’t make sense.