I don't see any problems with his observations.
This is because you have not yet learned much about history.
Consider:
Jefferson's wife was in intimate daily contact ... with her husband's concubine.Jefferson's wife died when Sally Hemmings was not yet nine years old.
or this other quote I picked:
As originally built his bedroom [at Monticello] accorded him no privacy at all, a curious oversight considering he had a passion for being alone and unobserved. Thereafter the search for privacy became an obsession in the many changes of design ... Contemporaries assumed they were there so his alleged mistress, Sally Hemmings, could slip in and out of his chamber unobserved.and contrast it with this written by Mr. Jefferson's granddaughter in 1858:
His apartments had no private entrance not perfectly accessible and visible to all the household. No female domestic ever entered his chambers except at hours when he was known not to be there, and none could have entered without being exposed to the public gaze.Do you have other information, or has your thought been poisoned by the "All Presidents do it," stories told by the Great Stainmaker and his minions?
ML/NJ