I hate their stealing the words “husband” and “wife” more than I hate their wanting to be married.
I suggest the words “gouse” and “louse” instead.
I am confused.... Are they each husbands, or is one of them the wife, or could two men both be wives. Just how is the nomenclature determined? I think your two words work much better.