Absolutely.
I am not driven by "religion", I get up and live day to day for a person - Jesus Christ.
Religion always let me down, because religion is a man made institution.
I worship at a Bible believing church, but I have worshiped at many of them during my frequent travels. If they are grounded in Jesus and the Bible, then I am welcomed there.
Any person, whether they are a layperson, or cleric, is WRONG if they do not follow God’s laws, but that doesn’t mean that the religion itself is wrong - the person, who doesn’t follow Church teachings is wrong.
I’m glad you read the Bible, but where does it say that you can leave the religion that Jesus started?
“And so I say to you, you are Peter, and upon this rock I will build my church,* and the gates of the netherworld shall not prevail against it.”
Jesus started the Church. The Church gets us to go to Mass each weekend, as well as other rules. Human nature would cause many of us to stay home on many Sundays, but the requirement to attend Church gives us more grace, because we are adoring God in the Church that Jesus fiounded.