All sin condemns, but there is indeed a difference in seriousness that God himself says that He recognizes. Sexual sin is at the extreme end of the seriousness spectrum. It led to destruction by fire of an entire geographical region, when other sins didn't call for this judgement.
If He recognizes these differences, then we ought to as well.
And in Romans, Paul indicates that homosexuality is a sign of rejection of God. How could one who has rejected God, lest they be under conviction toward repentance, want to be part of the church? The obvious answer is that they are there to destroy the church, not to strengthen it or seek reconciliation with God.