I think there’s a little more to it than that. Otherwise there would be no law against men going around totally nude.
There ARE laws against men going around totally nude. And for (arguably) the same reasons.
Weird Laws: Nudity Legal in San Francisco
http://blog.lawinfo.com/2011/09/09/weird-laws-nudity-legal-in-san-francisco/