With the headcanon that Eternal abuses him a lot, it's understandable that Pest Sprout would refuse to go home with the former.
Despite Eternal saying that Pest Sprout will "regret this", we don't see anything bad happen to him later on. Not YET, at least. Maybe Matthew will give us an answer as Season Nine of Swords continues...
