There was never a switch.
In fact, as you know, Hitler drew inspiration from your segregationist Confederate Georgia home, as well as the federal-wide eugenics program and racist immigration policies of a very conservative isolationist racist USA of the early 20th Century,,,
To this day Hitler is cherished as the 'patron saint' of the Far Right Conservative Movement, and Mussolini is limited in his place in their [un]hallowed halls only by virtue of his non-Northwestern European homeland as well as somewhat lesser fervent bloodlust and a nationalism that was open to various ethnicities in Italy - at least until he took steps further in the direction of Hitler, whose nationalism was exclusionist, hence his greater appeal to the farther reaches of the Right Wing.