But those were the words of Jesus spoken to Peter!?! What justification do you give for you disregarding Jesus' words? They are in the Bible, after all.
Mat 16:23 is also in the Bible. It sure looks to me that Jesus gave the keys to the Holy Spirit, not the fallible Peter. Further, one verse does not invalidate the entirety of Scripture. If a man possesses the "keys", he will adhere to God's will.