Correct. That's why you get married at your church.
State issued marriage certificates did not become common until the early 20th Century.
Previously, marriages were recorded by churches or noted in family bibles. No involvement from the government.
But there are too many atheists!
And there is too much chaos already—and it is growing!