Perhaps. There also seems to be a strand of heresy that begins below the belt.
Sanctimonious, self-righteous prigs, on the other hand, who degrade and humiliate those who have sexual issues are far more problematic. The Church is supposed to be a means by which God communicates grace, not condemnation. Unfortunately, there are far too many examples where the Church has humiliated or demonized gays, single mothers, and other sinners.
I'm a sinner too. My sins may not be sexual in nature, but they're no less serious.