I would contend that your statement is not always true.
People who are generally good and decent make mistakes and do bad things, including the having of affairs. For instance, I would consider a one-night stand as a slip to be less of a betrayal than an ongoing affair, which requires ongoing premeditation.
However, we can say with complete authority that when people have affairs they are not “doing good.
A one-night stand requires premeditation as well.
As for the "ongoing" part, it depends on what the meaning of ongoing is. :)