I think Lincoln said that in 1866, not 1864.
That gets us into the conspiracy theory that Lincoln wasn’t offed by a crazed Democrat at Ford’s theater . . .