You are the one who brought up Jimmy Swaggart. Here is a man who got caught in adultery. A lot of people rejected his ministry after that. My opinion is that anyone who does something like this in the ministry should leave and never be allowed to have any leadership. But since I never followed him or had anything to do with his ministry, it is not something I feel particularly exercised to address.
But Pope Paul III not only committed adultery and fathered illegitimate children, he opposed men like William Tyndale even to the point of having them arrested, imprisoned and killed because Tyndale wanted to help the common people have access to the Bible in their own language. So tell me if Pope Paul III represents the true authority of the Catholic church. Do you assert that Pope Paul III was the “vicar of Christ” on earth?
There have been good pope and bad popes. They are human.