I work on a ship canal and have have to work at heights and I swear I feel the same if I'm on the edge (windy) looking down gets me, but yeah, looking up has the same effect but in reverse, We have sky scrapers in Manchester, when I was a kid I looked up and went on a dizzy one, I have to be stood close to the building though to feel it. It is common i believe