That is extremely simple: for believers, the downside will be a sensible estrangement from God, a more distant walk. For the world, the worse it gets the worse their society gets. There is no escaping.
Well, those consequences simply don’t seem to be enough to discourage people. Perhaps it’s time to bring back legal consequences for betraying your marriage vows?