The distinction between behavioral and pejorative might be a good one if it weren't for the fact that it actually does keep getting used pejoratively. I appreciate if you haven't stooped that low, but many others do. The fact is, though, that it by it's very nature connects race, sex, and class to behavior, making it inherently pejorative, and thus also prone to such usage.