The faith is Jesus Christ and God. Not worshiping the church.
Which is exactly why faithful Catholics don't abandon His Church. Because of our faith in Him and His word and promise that His church will lead us to all Truth. You do not walk away from that because of someone else.
It's understandable because the protestant tradition is more "democratic". Preacher not up to snuff? Fire him (or her). Don't like something being preached? Leave and go somewhere else or set up your own operation.
Let's put it in secular terms. So many people here on FR bemoan that the MSM sets the agenda and the narrative forcing politicians to address what we rightly perceive as a false narrative and not the crux of the matter (See Ted Cruz's recent response to the MSM about gay rights).
The same principle applies here. Those who think this is a "Catholic" problem are perpetuating the false narrative and asking Catholics to respond to it.