Except we can date the archeological record and actually trace how they spread upward across North America in various directions within a decade or two.
If "hunted to extinction" means eohippus, I don't think anyone thinks that one was ever ridden, and it was quite a bit further back.