I agree. This is when people start doing things they normally wouldn't and things can escalate to road rage. Car vs. dump truck raging is one of the more bizarre things I've seen.
I had a man in a grocery store parking lot actually follow me and my kids around. It was at a Kroger where they have the gas pump at the end of the lot and the drive around part if a little weird so you were never sure how to pull in an out of the place. He was red faced screaming at me. We parked and ducked into a store and told the owner what was happening. I was worried he was going to do something crazy!
Good for you not to confront him. We all make driving mistakes (if people say they don't, they're lying). Yeah I just put it down to people unfamiliar with where they are as they may be from out of town.
Worst part is he was driving the wrong way! Since they don't put lines down I figured maybe he was just going where he thought he was supposed to. I hope I never see him again!