Case in point: the Masterpiece Cakeshop case before the Supreme Court right now.
If you don't interact with me, there is no way I can "impose my morals, beliefs, and values on you," in any way.
If people don't like me, carry on. If I don't like someone, I will still talk and debate with them until civility lapses and then I will simply carry on.