I read of a guy who did that and was told the same thing.
He apologized, saying, "Pardon me. I thought you were a lady."
We are probably taking about the same guy LOL. It was about a couple of years ago right?