You are partially correct.
After its defeat in World War I, and agreeing to the surrender terms laid out in the Treaty of Versailles, the German legislature in 1919 passed a law that effectively banned all private firearm possession, leading the government to confiscate guns already in circulation.
In 1938, Hitler signed a law allowing citizens to own a gun if they got a three-year permit. Members of the NAZI party were exempt from any restrictions.
However, all Jews, Gypsies, non-german citizens, and other persecuted classes where still forbidden from owning a weapon. This included everybody in all the occupied countries.