Well .. your interpretation of "being outside the church" does not compute. The Bible is not "the church's books", the Bible is God's Word TO ME!; and to all other believers.
Christianity is more than a way of life .. it is a heartfelt conversion by the power of the Holy Spirit - "unless a man is born again, he cannot see the Kingdom of God". If a person cannot "see" the Kingdom without this conversion, they reading the Bible without it would definitely be a hindrance.
When Jesus was asked the question - who will make up the church, He confidently said, "Those who believe in ME".
So .. that's the "church" I belong to. I may attend services at a church building where I do works, and monetarily support, but being a member of the "church" means I believe in the Lord Jesus Christ. Since I do, then I AM NOT OUTSIDE THE CHURCH.
Evidently, you do not believe anyone but those who belong to YOUR church - are inside the church - and you are sadly mistaken. It's not whether you attend a Methodist, Catholic, Presbyterian, Lutheran, etc. church building - it's whether you accept Jesus as the Son of God; your Redeemer and Savior. Romans 10:9-10 pretty much says it correctly.
Go and learn the history of how the Holy Scriptures came to be assembled in the form we now have them, then get back to me. Until you are conversant with the actual facts about the canon of Scripture, not theories spun centuries after its collection by folks eager to justify Luther's shortening of the canon, we will perpetually talk past each other.