If the right side had won, state governments would still choose senators, you’d need papers to cross the Mason-Dixon, and Lincoln with his progressive centralized government views would have lost re-election and gone back to being a lawyer.
You forgot one other thing that would have kept going if the South had won.