My argument is that the Church indeed does have authority.
It is NOT my argument that such authority is always used wisely.
I understand your point. However Jesus Christ tells us the authority we must follow:
Matthew 4:4 NKJV
But He answered and said, “It is written, ‘Man shall not live by bread alone, but by every word that proceeds from the mouth of God.’ ”