If the same sex act occurs between a man and a woman that occurs between two men or two women, yet the former is legal while the latter is not, that violates the equal protection clause of the Fourteenth Amendment.
Furthermore, such selective application of the statute forfeits the "public health" defense.
All you're left with is morality, which is God's realm, not Caesar's.