You’re correct. I should have said he saw removal as a/the solution. I don’t think there was any forward looking thought given to it.
I don’t recall if Robert E. Lee was a member of the American Colonization Society (ACS) but I do recall that he paid out of pocket for the emigration of a bunch of former slaves to Africa (Liberia I believe).