They're descendants of Greek Fishermen from the Iron Age. They're not natives to the region. That's why Arabs call em Bedoiuns and won't accept em. They're what Marxist professors call "White Invaders."
Why did ya think they worshipped a fish god (dagon) in a desert?