Since people are already accustomed to points here, then have them accumulated via views and comments.
Ridding the voting system eliminates the abuse of it. Downvoted into silence by the very crass and antagonistic sorts that the system is supposed to combat defies the purpose.
Likewise, so does people using alts to upvote themselves so they can continue to harass others. It only creates incentive for the creation of alts, even by those who play by the rules and only wish to have fun with memeing.
Using alts to upvote oneself into a more popular status is another issue. Trolls getting more prominence by cheating the system only furthers the ugly atmosphere shadowing over the site.
It also eliminates the charge from some that some popular memers use alts to upvote themselves. With points accrued from activity, creativity and popularity become key, not the notion of exploiting the system.
While it won’t eliminate all problems - worthy memes by unknowns slip by unnoticed only to see the same meme by someone else’s hand go front page or some inane fart hitting the top spot may seem unfair - such is life, and those people once were unknowns at the bottom as well.
Some, like myself, like it in the corners anyways. I do not envy the constant effort and time that go into replying to a massive amount of comments, and all the potshots one has to take simply for being at the top of the game.
But when even the most popular memers have to refrain from making political memes lest they get bombarded into nothingness, something isn’t right.
I admire people like yourself putting your neck on the line to say what not all are willing to, but why should that be met with intimidation?