And if Joseph Ratzinger were actually Peter in disguise, then you’d have a case.
Clueless. Biblical ignorance is the only possible way you can fail to understand that Our Lord gave that power to all the Apostles and to those they chose to join and succeed them.
The Apostolic Succession was recognized repeatedly by the early Church Fathers (e.g. St. Clement who lived and wrote in the 1st century) -- some of whom (e.g. St. Ignatius and St. Irenaeus) knew the Apostle John personally and studied with him.
In order to deny this, you have to think that holy men who actually spoke and studied with one of Jesus's apostles, and all of their successors, somehow "got it wrong" until the sixteenth century. . . . then, somehow, a few men who did not have the direct link with the Apostles suddenly "got it right". And, of course, if the early Church Fathers "got it wrong" . . . they were the men who compiled the Bible. What if they got that wrong, too? (Even Martin Luther couldn't bring himself to ditch the letter of St. James -- but it was close.)
It's much more straightforward and reasonable just to acknowledge the early history of the Church and disagree with it, if that's what you want to do.