I disagree with you. There are many “Catholics” who don’t attend church and do what they want. It’s impossible for the clergy to reach them.
I'm one of those people; I love the religion but I hate the church. It comes from a childhood of observing parish priests who acted like they were the people that Jesus chased from the temple with a scourge.