The courts have been making those calls since before there were any amendments, and reconciling free speech with people's right not to be libeled or slandered through all of our history.
https://www.mtsu.edu/first-amendment/article/997/libel-and-slander#