I think my brother’s problem was just the sex issue, nothing to do with competence. He was used to male doctors, and didn’t want to be seen by a female.
I must be a dinosaur, because I’ve generally preferred male doctors. I guess a lot of it is what you grew up with and are used to.
Definitely that too, though nurse fantasies have long captured men!