That's not a given. Of all her detractors, women by far are the largest and most vocal group. I personally think it is because they resent a successful conservative woman, who isn't at all hard on the eyes.
There are LOTS of conservative women who are not hard on the eyes.