Read the Proclamation. He spends more time listing the places exempt from the Emancipation than those where it would be enacted, let alone the Union slave states. It's about retribution for rebellion against the empire, not justice. There was no good side to that war.