Stolas literally cares more about Blitzo than spending time with his daughter. This is clearly visible in episode 2 of season 1. In that same episode he also used swear words and kinky play with Blitz in front of Octavia, who is underaged. In that same episode it is also revealed that when Octavia was a child Stolas actually sanged her a song about a universe collapsing. And he hypocritically calls Octavia and Blitzo out for swearing despite him swearing quite a lot to the point he gets censored.
Based on this info you can clearly see why both Octavia and Blitzo dislike Stolas.
