You quotation of our Lord and Savior isn't as forceful as its meaning provided to the believer by the Father.
Our Apostles knew through our Lord Jesus Christ that there would be strife for the office of bishop. For this reason, therefore, having received perfect foreknowledge, they appointed those who have already been mentioned, and afterwards added the further provision that, if they should die, other approved men should succeed to their ministry. As for these, then, who were appointed by them, or who were afterwards appointed by other illustrious men with the consent of the whole Church, and who have ministered to the flock of Christ without blame, humbly, peaceably and with dignity, and who have for many years received the commendations of all, we consider it unjust that they be removed from the ministry. Our sin will not be small if we eject from the episcopate those who blamelessly and holily have offered its Sacrifices. Blessed are those presbyters who have already finished their course, and who have obtained a fruitful and perfect release; for they have now no fear that any shall transfer them from the place to which they are appointed. For we see that in spite of their good service you have removed some from the ministry in which they served without blame.
The blessed Apostles [Peter & Paul], having founded and built up the Church [of Rome], they handed over the office of the episcopate to Linus. Paul makes mention of this Linus in the Epistle to Timothy. To him succeeded Anencletus [or Anacletus]; and after him in the third place from the Apostles, Clement was chosen for the episcopate. He had seen the blessed Apostles and was acquainted with them. It might be said that He still heard the echoes of the preaching of the Apostles, and had their traditions before his eyes. And not only he, for there were many still remaining who had been instructed by the Apostles. In the time of Clement, no small dissension having arisen among the brethren in Corinth, the Church in Rome sent a very strong letter to the Corinthians, exhorting them to peace and renewing their faith. ... To this Clement, Evaristus succeeded; and Alexander succeeded Evaristus. Then, sixth after the Apostles, Sixtus was appointed; after him, Telesphorus, who also was gloriously martyred. Then Hyginus; after him, Pius; and after him, Anicetus. Soter succeeded Anicetus, and now, in the twelfth place after the Apostles, the lot of the episcopate has fallen to Eleutherus. In this order, and by the teaching of the Apostles handed down in the Church, the preaching of the truth has come down to us
*I am sure many are well-intentioned but, we have the truth from Scripture, Tradition, and Church and those three sources are far superior to the personal opinions of our opponents.
"There is no doubt, and in fact has been known in all ages, that the holy and most blessed Peter, prince and head of the Apostles, pillar of the faith, and the foundation of the Catholic Church, received the keys of the kingdom from our Lord Jesus Christ, the Saviour and Redeemer of the human race, and that to him was given the power of loosing and binding sins: who down even to today and forever both lives and judges in his successors. The holy and most blessed Pope Coelestine, according to due order, is his successor and holds his place."