I mean, you could argue it's offensive because it's not strictly true and not a view historians espouse?
I'll be the last to argue the Founding was perfect, but you malign a huge swathe of Americans, far more than not, if you argue that conservatives want to go back to an era of institutionalized racism.