If Cain got complaints, it probably wasn’t from any conservative ladies, who wouldn’t blow an innocent gesture way out of proportion. Liberals might be another story.
As a factory foreman I found that I had to go out of my way to treat women differently to protect myself from accusations. Basically I had to be a real jerk to the females in my department to crush any thought of harassment accusations before they started.