You’re the one who’s able to drive.
You’re the one who decides if they get to meet.
You’re the one who can choose not to care.
I shouldn’t have to spell this out for you I already did it twice. The ball is in your park. Stop being scared about what others might think. You know what you want to do.