This used to bother me, too. I would think, How can there be so many views, but so few upvotes?
But I think it's because users need to be signed up members who are logged in to upvote a meme. If you're seeing the meme via another site or via Google searching (or however people see them that counts as a view), you might not be logged in.
I would say try not to stress out about it, and keep making memes that are fun for you.