I lived in NJ and I did look in PA before making my move. I didn’t find PA all that much less expensive than NJ. Once outside of North Eastern NJ (BERGEN COUNTY) area it is about the same.
I moved to NC and bought a new 2200 sq ft Townhome in Union City for $175,000 (well over $300,00 in Bergen City) and taxes were just a tiny tad over $1000 annually. Unlike the crumbling N East, NC and surrounding States have a superb infrastructure and a sort of new feel to everything.
I find living in the South many, many times better than in the N East.
NJ v. PA- its all relative. Yes, the South is cheaper but I have to stay in the NE for now. PA is much better than NJ when comparing all taxes and cost of living.