You, sir, are hanging around the wrong men.
I had (note the past tense) a friend who cheated on his wife. The urge to leap across the table and throttle him as he (tried to) justify cheating on his wife was nearly overwhelming. He proved himself untrustworthy in his marriage, and (what a coincidence) went on to commit fraud in his business and (other) personal dealings, too. He lost his marriage, his business, and his friends, because he believed his cheating ways were all justified. He's defaulted on loans, forged signatures, and occasionally "appropriated" unattended money. He's fathered an illegitimate child. He pawned his wedding ring (how symbolic is that?). And he has told me that he doesn't need to repent of anything. No one will loan money to my friend to bail him out of his troubles (and those that have were never repaid). Everyone has seen, first-hand, that he's untrustworthy, in every meaning of that word. He has no friends, except those who see him as a charity case.
Conversely, I know a man who talked a married friend out of "having a fling" with a willing old flame. The friend now credits this man with saving his marriage, and the two have maintained strong friendships and marriages in the years that followed (and their credit scores are sky-high). Bottom line is that they trust each other, and they are trustworthy.
There's a reason married men (ought to) wear wedding rings. They serve as reminders of a solemn vow we took facing a beautiful woman, that we would always honor that woman by being faithful to her. Men who break their vows are more than adulterers - they are liars and thieves as well.
I don't disagree with a word you wrote. Yet men will be men just as much as boys will be boys. It has nothing to do with the people I know. If an attractive woman turns on to a guy, his buddies will root him on. Maybe it's just a little ribbing and it's probably not entirely serious, but it does happen.
I think it is very self-reflexive: people will be a bit easier on their own sex when it comes to these matters. That's not to say they will endorse the bad behavior. It is to say that in many cases, the dynamic is as I described it.