That may have been the same question Adam and Eve had over the apple. It seemed like a small thing.
It matters to God and that should mean something. That should carry weight. We all have to be accountable to God and IF He asks you why didn't you obey His Ten Commandments, what will your answer be? You know the verses "IF you love Me, keep my Commandments" and many others and the excuse may sound pretty lame on that great and fearsome day.
Whom does He tell "Depart from Me, I never knew you?" Atheists? No Agnostics? No These are people claiming, grace, miracles in His name and the right soteriology. They are completely shocked.
Going to church on Sunday has nothing to do with salvation.
A Pharisee would say that though.
Adam and Eve predated the Age Of Grace. All new rules.