He definitely had an affair with one woman - the widow of one of his political rivals from his secular career, and this affair almost certainly continued during his Papacy.
He also supposedly played at dice and hunted and completely neglected his duties in favor of politicking.
In other words, he behaved exactly like a typical petty nobleman of his day, instead of taking his responsibilities seriously.
But not even his most dogged enemies accused him of holding orgies.
"But not even his most dogged enemies accused him of holding orgies."
From wikipedia:
"Much that is alleged about the pornocracy comes from the histories of Liutprand, bishop of Cremona. Liutprand took part in the Assembly of Bishops which deposed Pope John XII and was a political enemy of Rome; he is described by the Catholic Encyclopedia as "ever a strong partisan and frequently unfair towards his adversaries." The worst excesses of the time might be considered no more than ecclesiastic gossip."
Most petty noblemen drew the line at incest.