Not so, because individual believers make up the church, the body of Christ.
We are to take our disputes to other believers as we are to judge disputes between believers.
So we believers (excluding Catholics?) have the authority to judge disputes between believers, as those believers have authority to judge disputes with us, or with other believers.
So how, exactly, do disputes get resolved?
As I said, this approach makes the Lord's command to take our disputes "to the church" meaningless, since disputes would be unresolvable.