I've done the same...took a rather large hit on pay and I had to move to boot...but it turned out to be one of the best decisions I ever made. I absolutely HATED the job I was at and it was starting to take a toll. Working to live, rather than living to work, is the difference between fulfillment and wage slavery and if you can choose the former and pay the bills, you will find soon enough that you, too, made the right decision.
Best to you :-)