Or mutilated cross-dressers.
Many men have had to have their penis's removed because of an accident or because of cancer or infection. I think they would be shocked if told they are no longer men because of it.
Males have XY chromosomes, females have XX.
When someone can change that, I will believe they have changed their sex.