I can’t find any evidence of state issued marriage licenses till shortly before the civil war in Kansas. If I recall correctly it was a legal maneuver having to do with whites marrying blacks and statehood.
Marriage licenses have existed for many centuries, since the 1300s, and before that Banns, and before that other formal actions that made marriage legal, Thomas Jefferson obtained a marriage license, George Washington paid for the license for his favorite nephew.