“The whole thing with Lincoln going to war was to preserve the Union. The slavery issue was not a factor at the time.”
This isn’t rocket science. Just take one little backward steps. Lincoln went to war to preserve the Union why? Because the South seceded. Why did it secede? Because of slavery.
(ps - did you do some traveling in the East?)