There’s probably no way to know. He lived during plague years so any contact may have been seen as dangerous. Marriage was almost a business transaction in those days and casual sex outside of marriage would not have been made public. He may have had a fling or two (or more) but there would not have been any record kept.
People forget, prior to about 1940, there was no cure for Syphilis or Gonorrheah, er, Gonnorheah .. eh, the Clap. They were just like AIDS, more or less deadly, debilitating, and caused people to go crazy when it infected the brain.
The leftists always want to portray the “Puritans” or other proscriptions against casual sex as being “uptight” or they were all benighted religious freaks and the rest if it. There were very good reasons. Infidelity meant bringing home incurable diseases. The “French Pox”.
Mercury was the treatment of choice for Syphilis, if I recall my history. The dosage was considered about right, if mercury was seen oozing out of the scalp when squeezed. Historians/archaeologists look for traces of elemental mercury at suspected campsites of the Lewis & Clark expedition, as the captains treated most of the enlisted men for venereal diseases caught from the native damsels on their way up the Missouri into the pacific northwest. At one point some of the men had no buttons on their clothes, having traded them for sexual favors.