They already have issue with him from the past when he tried to touch up the wives and children at parties and would swim nude in the pool at same said parties. None of them would bring families to his gatherings for which they were invited. And female Secret Service refused to go on detail with him for similar reasons.