I would first say that the true church would have to have what Christ taught in it, i.e. his doctrines, and that would be the way to identify it historically back through time.
That one can claim this church has specific doctrines taught by Christ is established here by the authority given to specific leaders of his church: "And Jesus coming, spoke to them, saying: All power is given to me in heaven and in earth..Going therefore, teach ye all nations..Teaching them to observe all things whatsoever I have commanded you. And behold I am with you all days, even to the consummation of the world." Mt 28:18-20.
His church would still be teaching his same doctrines today because Jesus said "I will build my church, and the gates of hell shall not prevail against it." Mt: 16:18. This is how we would know it's the "one true Church". If the "gates" or "powers" of hell were to prevail against this church it can no longer claim a divine origin.
So the above verse, Mt 16:18, I would present as the historical, i.e. biblical evidence, that you asked for concerning Christ establishing one true Church.
Regarding the particulars of ritual:
First I would claim that all the particulars are not mentioned by Christ in Scripture and that they would not need to be because beside the written tradition we find also and oral tradition in Scripture that was claimed to be authoritative: "Therefore, brethren, stand fast: and hold the traditions, which you have learned, whether by word or by our epistle."
1) Baptism: "baptizing them in the name of the Father and of the Son and of the Holy Ghost."Mt 28:19
That water was believed to be necessary when baptizing we find also in Scripture: "And he commanded the chariot to stand still. And they went down into the water, both Philip and the eunuch. And he baptized him." Acts:8:38
2) Confirmation: "Then they laid their hands upon them: and they received the Holy Ghost." Acts:8:17
"Of the doctrine of baptisms and imposition of hands, and of the resurrection of the dead, and of eternal judgment." Heb:6:2
Eucharist: " And taking bread, he gave thanks and brake and gave to them, saying: This is my body, which is given for you. Do this for a commemoration of me." Lk:22:19
Confession: "Whose sins you shall forgive, they are forgiven them: and whose sins you shall retain, they are retained." Jn:20:23
Extreme Unction: "Is any man sick among you? Let him bring in the priests of the church and let them pray over him, anointing him with oil in the name of the Lord." Jms:5:14
Holy Orders (Priesthood) "You have not chosen me: but I have chosen you; and have appointed [ordained] you, that you should go and should bring forth fruit; and your fruit should remain: that whatsoever you shall ask of the Father in my name, he may give it you."Jn:15:16
"For every high priest taken from among men is ordained for men in the things that appertain to God, that he may offer up gifts and sacrifices for sins:" Heb:5:1
"For this cause I left thee in Crete: that thou shouldest set in order the things that are wanting and shouldest ordain priests in every city, as I also appointed thee:" Ti:1:5
I didn't mean to make this reply too long, I would gladly keep things more short if it's okay with you? We can narrow things down perhaps..
Oh no, I actually am enjoying reading the passages. The length of reply is not at issue. In fact, I would enjoy your being even more thorough. As any reader goes through the passages, the Gospel of Grace transmitted through His Church and to His Church is most valuable.