The whole story revolves around the Jefferson in Paris myth: he seduced the young girl in Paris, got her pregnant, and she bore his child shortly after their return. Except that she was not pregnant with any child of his upon her return from Paris, and apparently wasn't pregnant at all at the time.
If the pillars that held up the "big house" have collapsed, there is no reason to try and resurrect the structure.
Your dichotomy is false. Slave girls got pregnant all the time, without their masters necessarily having slept with them, or having "pimped [them] out."
We'll he owned her and he or one of his relatives is the father. So his relatives came in and did the deed with her in his home and TJ didn't know. Was this because he was out of town and his relatives had free run of the house...........slaves.
The scenario where he doesn't know doesn't seem very gentrified to me, thus my two choices.