I notice upvotes disappearing every once in a while. But for me due to the way I ended up here it doesn't surprise me. Although I have noticed that it does get to point where they can't do it anymore, unless of course they create another alt. Just my opinion.
Although the other night I did get a comment timer and I haven't gotten that in a while. I don't base my life or popularity on my imgflip score, an if people wish to be a**holes you can't control that. But you do have control over how you react, and often that's what these people are trying to do is get a reaction from you, so they have rationalization to pursue you further. So your the one really in control of how and how much they effect you. :)