It was not upon Peter which the Lord said He would build His church, but upon the truth Peter uttered when Jesus asked “but who do you say that I am” to which Peter responded, “ you are the Christ, the Son of the living God”.
That's not what the Scripture says.