You are not crazy. There is already a provision in the International Criminal Court statute which is designed, in part for this very purpose. It is a vaguely defined "crime" called "persecution," which consists of denying any fundamental human right to any group or collectivity, or words to that effect.
Since "marriage" has already been defined as a fundamental human right, this statute will inevitably be used to imprison some priest or pastor who refuses to perform a marriage for a same-sex couple.
Thank you. I have always figured that it wasn't about two gay guys who just want to settle down in bliss. They have been doing that for years. I figured it was a leftist strategy to bring down the church in America and make it almost impossible for them to carry on in their faith with the extra added benefit of no longer being tax exempt added in as a bonus.