If you don’t have state certification that you’re married then how can you get divorced?
As I read it, the parties to the marriage present a certificate of marriage after the fact. I’d imagine divorce could still take place as a private matter resolved between the two.