I.e. Palpatine was a genocidal maniac and his family would have avoided him at all costs, knowing how dangerous he was. Not to mention, Palpatine was kinda recovering in an underground laboratory aided by cultists, AFTER BEING ELECTROCUTED AND PERISHING IN AN EXPLODING SPACE STATION. Plus, his son was more of a creation than a child (in the legends comics, it's stated that his birth made him basically Anakin with Palpatine DNA)