That's not the same as saying that faith alone doesn't save you. The bible doesn't say you have to be baptised to be saved.
"Jesus answered: Amen, amen I say to thee, unless a man be born again of water and the Holy Ghost, he cannot enter into the kingdom of God" (John 3:5).
Footnote: "Unless a man be born again"... By these words our Saviour hath declared the necessity of baptism; and by the word water it is evident that the application of it is necessary with the words. Matt. 28. 19.
Mar 16:16 He that believeth and is baptized shall be saved; but he that believeth not shall be damned.
Jam 2:14 ¶ What [doth it] profit, my brethren, though a man say he hath faith, and have not works? can faith save him?
Jam 2:15 If a brother or sister be naked, and destitute of daily food,
Jam 2:16 And one of you say unto them, Depart in peace, be [ye] warmed and filled; notwithstanding ye give them not those things which are needful to the body; what [doth it] profit?
Jam 2:17 Even so faith, if it hath not works, is dead, being alone.
Jam 2:18 Yea, a man may say, Thou hast faith, and I have works: shew me thy faith without thy works, and I will shew thee my faith by my works.
John 3:5.