It doesn't necessarily follow that a bunch of socialists followed Mussolini when he founded the Fascist Party. I don't deny that some converted, it was just very rare. Mussolini was denounced by his fellow socialists and removed from the Socialist Party.
In the case of Nazi Germany, it is estimated that about 1 in 10 Social Democrats converted to the Nazis. Even less in the case of members of the Communist Party. The NSDAP was simply the most popular right-wing party in Germany by 1933, after the wave of splinter parties died off.