‘I’ll pile on with Galatians 3.’
Apparently on my side. You are exactly right.
Paul is essentially saying that the brother/sister that does the dietary/holy day observance is the weaker brother/sister and they should not be judged. Here's the text:
"Accept him whose faith is weak, without passing judgment on disputable matters. One man's faith allows him to eat everything, but another man, whose faith is weak, eats only vegetables. The man who eats everything must not look down on him who does not, and the man who does not eat everything must not condemn the man who does, for God has accepted him. Who are you to judge someone else's servant? To his own master he stands or falls. And he will stand, for the Lord is able to make him stand."
Don't judge them, but OTOH being a more religious person (i.e. dietary restrictions/holy day restrictions) is not something any Christian should aspire to.