Well, think of it this way: a temple marriage wouldn't have had any more effect on your immortal soul than leaving cookies and milk for Santa. You got out, that's the main thing!
Its no that, its that a Temple Marriage (and kids) would have made it harder to leave.