Potentially, yes. At the same time, some forms of dress are provocative just as some behaviors are. If you are going to wear X, then it is your responsibility to consider the potential reaction of others to what you are wearing and be prepared for it -- regardless of what your "rights" are.
In other words, feel free to wear a MAGA hat into a liberal bar. After all, it is your right. But don't cry about it if you get your ass kicked. Don't troll and complain that you weren't expecting a reaction.