He's also surrounded by controversy. The Tuck Rule, Deflate Gate, and some strangely beneficial officiating. Forget the SB, the whole playoffs were an officiating joke.
But set that aside for a moment. Goat? Really? You think Brady would still succeed when head slaps and clothesline were legal? Would he still be successful against guys like Deacon Jones and Mean Joe Greene, Fred Biletnikoff and Ray Nitschke? I doubt it.
You can't compare him to the QB's of the past because the game has changed so much. Just the attempt is kind of disrespectful to Hall of Fame players. Add back in all the controversy and you get Meh.