Not to mention that it's one of those sins one really has to work at committing.
Absolutely. It hurts many, many people- not just the spouse/children. Of course they are the main ones effected, but the cheater is now untrustworthy in the eyes of many people in a way they usually do not anticipate.