No, most of Antartica's frozen water is ON land. Same for Greenland and other land masses going up north. That's a bit different than water freezing atop water.
In fact, sea levels should have been noticably HIGHER since the end of the last ice age, with much of Floida under water and most of Greenland ice free, for example. Scientists can't explain why it isn't. We've been WARMER than we have been.