Having just the popular vote would cause imbalance, as the states that are smaller in size like Rhode Island, Delaware, etc. would have barely any impact compared to the bigger ones because they have less population. They would be barely represented in the vote, and that is the whole reason the electoral college was put into effect, to balance the vote and give equal representation.