Of the comments on that meme, the one I think said it best was Evilmandoevil's.
I've thought about deleting my account too a lot of times. I don't think it matters that much if you do or not. All you lose is the points you've accumulated, which is no big deal. Plus I guess people would have to get to know you again if you come back.
I hope you stick around, because you seem like a good user, but whatever you decide about your account is not going to affect your life that much either way.