I think that claim is debatable. He set up business events as cover for the trysts and must have taken staff and security with him.
This is the dumbest political claim since Stalin said, “At least I didn’t have a holocaust.”