The FACTS of your popes that were WAY worse than Luther seems to affect you the same.
We had bad popes indeed, but no bad pope left any legacy is bad encyclicals, apostolic letters, and such. He was bad and now he is gone.
Luther, on the other hand, remains very much at the root of the heresy he started. It is then appropriate to see what moral character the founder of Protestantism had.
Further, no, we did not have popes "way worse" that Luther. Some were boozers, womanizers, and self-serving jerks. None got themselves ex-communicated and started sects in defiance of that.
Incidentally, -- since you bring this up, -- Luther's shenanigans with the fish barrel woman are worse than a mere sin of the flesh because they sealed his ex-communication by acts that could not be easily repaired if at all. Before, he could return to the Church by fixing his theological errors publicly and repenting. Now he had a woman whose life he ruined by snatching her out of the monastery, for whom he became responsible as head of the family he built illicitly.