And the Pharisees and the scribes grumbled, saying, This man receives sinners and eats with them.
This is not about whom he’s eating with. This is what he is teaching. The whole purpose of the Petrine office is to uphold the doctrine of the faith.
Christ had hard words for the actions of the Pharisees but he also told people to observe what they taught because they occupied the seat of Moses.