Lincoln, among others of our forefathers, tried to warn the American people of this eventuality. The Congress to whom he appealed for authorization and funding to remove them back to Africa, turned down his requests.
Now, we have indeed inherited the whirlwind.