Downvote buttons are useful for when people post outright offensive or malicious memes or comments.
It used to be that if a featured meme received enough downvotes, it would be bumped back to submission. Even though the downvotes aren't visible any more, I presume that still happens.
Also, if a comment on a meme receives enough downvotes, it gets hidden so that you have to click to show it.