Some American cities have foreign names. Like in Ohio there's a city called Moscow. There is actually a city in Vermont called Montpellier.
The reason why it has a French city name could be because Vermont borders Quebec, which is a mainly French speaking province of Canada.