On the subject of Nazi's, after Germany lost WWII, they tore down all the Nazi statues, and the statues of Hitler. I think that is to "right the wrong" of the horrible actions of the Nazi's and of Hitler himself, that they were not going to glorify it by keeping the statues up, after WWII was over.
I guess the same argument could be made about the confederates in the United States, by seceding from the Union, they could be seen as traitors to our country. In this day of racial tension, it could also be noted, that since these people own slaves, that, alone, can also cause more tension. That is probably why, in this day in age, people want those statues down! I just don't support it, because I think people need to be educated on history.