A northern worker could always quit his job and pursue opportunities. A slave wasn't allowed to. Big difference.