Even after the Emancipation Proclamation, two more years of war, service by African American troops, and the defeat of the Confederacy, the nation was still unprepared to deal with the question of full citizenship for its newly freed black population. The Reconstruction implemented by Congress, which lasted from 1866 to 1877, was aimed at reorganizing the Southern states after the Civil War, providing the means for readmitting them into the Union, and defining the means by which whites and blacks could live together in a nonslave society. The South, however, saw Reconstruction as a humiliating, even vengeful imposition and did not welcome it.
After the Civil War, with the protection of the Thirteenth, Fourteenth, and Fifteenth Amendments to the Constitution and the Civil Rights Act of 1866, African Americans enjoyed a period when they were allowed to vote, actively participate in the political process, acquire the land of former owners, seek their own employment, and use public accommodations. Opponents of this progress, however, soon rallied against the former slaves' freedom and began to find means for eroding the gains for which many had shed their blood.
http://memory.loc.gov/ammem/aaohtml/exhibit/aopart5.html
But according to Abraham St. Lincoln, the South couldn't secede, so they could have never "left".
That is what I posted. (rolling eyes)