No Confederates wished for a European invasion, they fought against an invader. Those desirous of European invasion would have included the past governors of Massachusetts and Connecticut who refused to call up their militia in response to President Madison's and Congress' request for militia.
Gov. Caleb Strong received the following from the War Department,
July 21, 1812.Patriotic Americans? I think not.Sir,
By information received from Major General Dearborn, it appears that the detachments from the militia of Massachusetts for the defence of the maritime frontier, required by him under the authority of the President, by virtue of the act of the 10th of April, 1812, have not been marched to the several stations assigned them. [emphasis mine]
It’s not a North or South thing. Any New Englander who would stand by and allow our nation to be invaded was just as traitorous as any slavery-loving Confederate who earnestly desired a European army to arrive to kill their fellow Americans.