technically there are a limited number of universe, a hell of a lot, but not infinte
this is because there are a finite amount of factors to change. you might say "but numbers are infinite" and that's true but eventually they will also reach a limit, because they'll break the laws of physics
those laws (assuming they are constant in every universe which they should be) are the only reason there aren't infinite. there's still a hell of a lot tho so practically