I can see why you think that way, especially with the way he treated African people and Native Americans, and him causing the Panic of 1837. But I think you're missing out on his accomplishments:
- Participated in the War of 1812
- Paid off the national debt
- Used Jeffersonian philosophy, the belief in the high worth of the individual (Based on Romans 2:11 and John 3:16, both passages in the Bible)
- Formed the foundation of what would become the Democratic Party
- Significantly boosted the US economy
- Was favored by basically the entire country, from the South, West, and North sections of the US.
If anything, he was a good president in terms of strengthening the government, as well as placing a high value on the individual.