Simple. Have a guard at the restroom doors with scissors. If a guy wants in the ladies room he gets snipped first.
If I had a daughter, and she needed to use the ladies room, I would be that armed guard.