Indeed it does, and it's protected from governmental infringement by both the 9th and 10th amendments. When the Constitution and Bill of Rights were written, marriage was not a concern of government at least not of legislautres. It was a concern mainly of the churches, and secondarily of the courts. Hence "common law marriage", which is marriage outside both church and state.
The same is true of birth records. Those were strictly private and church business until much more recently than the late 1700s.