In the beginng was the Word, and the Word was with God, and the Word was God.
The Bible, being the written Word of God, existed before the Church. Christ himself quoted Holy Scripture - the written Word of God at the time.
So i will also ask you the same question as to the polemic behind this assertion:
Are you saying that the Divine promises of His presence and preservation, (Jn. 14:16; 16:13) necessitate an infallible church, and that being the historical instruments and stewards of Scripture means they are the infallible interpreters of it ["we gave you the Bible so.."], so that dissent from them is rebellion against God?