Then how do you know he didn't say it? Or something to that effect?
It was widely reported at the time. Of course newspaper articles are no good. Unless they support the Neo-Confederate position.
https://www.loc.gov/resource/rbpe.24402000/?st=text