Before you take this gentleman's well meaning but wrong advice, please read the works of the Fathers of the Church. Sola Scriptura was definitely not the position of the Early Church, and was unheard of until the late Middle Ages.
Really? That would have been news to these guys below. It's evident that: (1) you don't know what the doctrine of Sola Scriptura means; and (2) if you understood it, you would see how pervasive it really was as the doctrine of the early church until around 400 A.D., and in many circles, much longer. These aren't a few quotes taken out of context, but rather a small sample of the consistent teaching of the church for roughly the first 400 years of its existence.
Origen (185?-252)
We know Jesus Christ is God, and we seek to expound the words which are spoken, according to the dignity of the person. Wherefore it is necessary for us to call the Scriptures into testimony; for our meanings and enarrations, without these witnesses, have no credibility. (Tractatus 5 in Matt.)
No man ought, for the confirmation of doctrines, to use books which are not canonized Scriptures. (Tract. 26 in Matt.)
As all gold, whatsoever it be, that is without the temple, is not holy; even so every notion which is without the divine Scripture, however admirable it may appear to some, is not holy, because it is foreign to Scripture. (Hom. 25 in Matt.)
Augustine of Hippo (354-430):Let them [the Donatists] demonstrate their church if they can, not by the talk and rumor of the Africans; not by the councils of their own bishops; not by the books of their disputers; not by deceitful miracles, against which we are cautioned by the word of God, but in the prescript of the law, in the predictions of the prophets, in the verses of the Psalms, in the voice of the Shepherd himself, in the preaching and works of the evangelists; that is, in all canonical authorities of the sacred Scriptures. (De Unit. Eccl. 16)
(On the Unity of the Church, 16, quoted in Martin Chemnitz, Examination of the Council of Trent, Part I [Saint Louis: Concordia Publishing House, 1971], p. 159.)
What more can I teach you, than what we read in the Apostle? For Holy Scripture sets a rule to our teaching, that we dare not “be wise more than it behooves to be wise,” but be wise, as he says, “unto soberness, according as unto each God has allotted the measure of faith.”
(On the Good of Widowhood, 2, in The Nicene and Post-Nicene Fathers, First Series, Volume III, p. 442. The quotation is from Romans 12:3.)
In those things which are clearly laid down in Scripture, all those things are found which pertain to faith and morals. (De Doct. Chr. 2:9)Hippolytus ( -230?)
There is one God, whom we do not otherwise acknowledge, brethren, but out of the Holy Scriptures. For as he that would possess the wisdom of this world cannot otherwise obtain it than to read the doctrines of the philosophers; so whosoever of us will exercise piety toward God cannot learn this elsewhere but out of the Holy Scriptures. Whatsoever, therefore, the Holy Scriptures do preach, that let us know, and whatsoever they teach, that let us understand. (Hip. tom. 3, Bibliotheque Patrium, ed. Colonna)
St. John Chrysostom (c.347-407):
[The Scripture], like a safe door, denies an entrance to heretics, guarding us in safety in all things we desire, and not permitting us to be deceived. ...Whoever uses not the Scriptures, but comes in otherwise, that is, cuts out for himself a different and unlawful way, the same is a thief. (Homily 59, in Joh. 2:8)
Formerly it might have been ascertained by various means which was the true church, but at present there is no other method left for those who are willing to discover the true church of Christ but by the Scriptures alone. And why? Because heresy has all outward observances in common with her. If a man, therefore, be desirous of knowing the true church, how will he be able to do it amid so great resemblance, but by the Scriptures alone? Wherefore our Lord, foreseeing that such a great confusion of things would take place in the latter days, ordered the Christians to have recourse to nothing but the Scriptures.