It is a survival instinct caused by your brain's automatic threat-detection system responding to subtle environmental cues in sound, light, air movement, or shadows in your peripheral vision. Evolution favors false positives. It is safer for your brain to mistakenly feel watched when you are alone than to fail to notice an actual predator.