Think you are forgetting the splinters in Protestantism caused by disagreements about Scripture. Among those splinters, there is no authority to which opposing pastors can go.
Your reliance on all writings and utterances by Popes as official teachings of the Church is where you make your mistake about Catholicism. Other than rare ex-cathedra teachings the Pope standing alone is not infallible. The Church teaching which has always been taught or is implicit therein and which has been held by the bishops throughout the world and ratified by the Pope is infallible. This type of infallibility is usually found in Ecumenical Councils.
Orthodox Catholics tend to understand this. They also know that infallibility attaches to faith and morals only.
You are correct about the scandal attatched to kissing Ted Kennedy as a saint. But millstones hang on Bishop’s necks who do that. Further, orthodox Catholics do not agree with such actions. Also long time tradition holds that the road to Hell is paved with the skulls of Bishops.
Anne Fremantle’s book “The Papal Encyclicals” has an interesting explanation of the significance of Papal prononcements.
Authority is given by the Holy Spirit to individual men in the gifts they receive.
Additonally, all believers have a level of spiritual authority given by being in Christ.
God did not create a top down heirarchal organization to lord it over people and dictate what they are to believe.
Is God going to give us a theology exam to get into heaven?