Users notice your memes, they all (or almost all) have upvotes right? I guess do what feels right to you, don't worry to much about what other users say. Some of the memes I spent the most time on didn't get very far in terms of upvotes, but they cracked me up when I made and submitted them, and they still do.
Some users get worked up if someone uses their image, when its really a compliment to them. Personally, I am fine if someone copies, tweaks or uses any of my creations. I know socrates is the same way
imgflip.com/i/1wmm3x imgflip.com/i/1vvbax and there are also a lot of other users here who feel that way too.