Marriage doesn't exist without some form of authority to make it exist. It is not an individual act that exists without some kind of government.
Find me a society that has marriage, and I'll show you a tribe, nation, or belief system.
So really the question becomes "whose authority," and who recognizes that authority.