You're operating under the old paradigm. It's a nice thought, but unfortunately... the guys with the most votes on the court get to have their way. That's the reality.
It's always been that way. It's not like the court just started using a majority voting system last year.
You want a "yes man" because you feel it is expedient. The problem is that "yes men" can't be trusted.