Genesis 16:12-14
And he Ishmael will be as a wild ass among men; his hand will be against every man and every man’s hand against him, and he will live to the east and on the borders of all his kinsmen.
Goes back further than that when Noah cursed his youngest son for catching him drunk and naked then blabbing about it. All the descendants of that son end up being enemies of Israel up to this day.