That is a false dichotomy, and it is contrary to what we see in the New Testament.
What I mean by that is rules, rites and rituals. LDS place their faith in ‘a church’ not Jesus.
I attend church, I read my Bible, I minister to others, I’ve even taught Sunday School. To many I would seem ‘religious’, but my faith is in Christ, not a denomination to save me.