The misuse of “cast the first stone” drives me nuts. Jesus was asking the men to cast a stone (a vote) if the had been sinned against(witnessed the act of sexual misconduct). No one saw the act, therefore no one would cast a stone.
I always thought it was “Let he who is without sin cast the first stone.”