Yes, but only if the decision was based on sex, rather than qualifications. (And just what ARE Harriet Miers' qualifications, anyway?) The mere fact that a decision was based on sex implies that the decision was a sexist one. "Diversity" is another way of saying "politically correct sexism/racism".
I agree completely.