As if you were not a man? Listen to yourself: you are giving to yourself the same authority that the Church claims.
As if Peter, Paul, Moses, Abraham were not a man? HIS own hear HIS voice and they know Who they will follow - man has a choice. There are those who hear/obey God follow Him and those who hear from evil, follow evil.
" And if it seem evil unto you to serve the Lord, choose you this day whom ye will serve; whether the gods which your fathers served that were on the other side of the flood, or the gods of the Amorites, in whose land ye dwell: but as for me and my house, we will serve the Lord " Joshua 24:15
The Catholic church is wrong for claiming it for itself.
Jesus DOES give believers in Him authority.
To begin with, He gives them the right/authority to become children of God by receiving Him. John 1:12