You might have a point of alarm, if Jefferson was accused of having relations with multiple slaves. I don’t view it as a point of an alarm if he was having relations with just one slave and he was treating her as he would a wife.
It isn’t an issue for me, because I don’t believe there is any evidence at all that he had relations with any slave.