"Majority rules" was invented for just that problem. It's not perfect, but there is no alternative that works.
Understood....