If you're condemning Lincoln for that then you must really hate the Confederate leaders.
It means that the rights of black citizens was hardly his foremost concern. It, therefore, was not motivating his war effort.