No no no. The correct response is "And...?"
And really, the majority of people don't care if you're vegan unless, as with any other lifestyle choice, you start making a holy crusade out of it and trying to force others to adopt your ways. Especially helpless infants or pets who can't make their own free choice.
This applies to anything, not just dietary choices.