So what? The vast majority of slave owners (and TRAITORS) lived in the South. We didn't have to send Federal troops Connecticut to smash its anti-constitutionalist conspiracy.
The slave owners are no more. The TRAITORS seem to be in New England and California, with perhaps some other infestations in places such as Illinois and NYC. Occasionally they show up on FR. To be totally safe from their presence one can go to any recruiting station. They never go there.