I agree. You want to get married, go to DC.
Or the arm of DC that's the most convenient to you - SS office or federal court, e.g. Better still, just apply online or call it in. Why do you need to show up in person anywhere? You can apply online for all sorts of licenses - why not a marriage license? Leave the religious aspects of it to religious institutions.