It’s about the percentages.
So some men would deny women the right to vote because the women vote in a way that those men don’t like?
Is that how we decide who gets to vote? Whether they agree with us or not?
Would that work for you for a liberal to say that men should not have the right to vote because they vote conservative/Republican?