Like your tags say though, unless it's a hate comment it's good etiquette to upvote. Even if you're having a disagreement, if it's at least civil upvote out of respect that they've having a civil conversation with you.
Well TBH, I never up vote without leaving a comment. :)
But I have the same problems with people being stingy, in fact, I made a meme about it yesterday :D