Well... I destroy just enough trees and things to get a house, I use the /summon commands to load villagers straight into where I want them (can't miss being "free" if you initially spawned in my house and have never known the outside world), I follow a vegetarian diet and only get wool by shearing the sheep (instead of killing them), the only structures I ever build are a house and maybe a barn to house my summoned sheep/chickens...
Explain again how I'M the bad guy?