True. But you have taken the event out of context. Jesus called to Matthew, the Tax Collector, to follow him. This following meant imitating the pattern of his life - not just walking after him.
As he sat at table in the house, behold many tax collectors and sinners came and sat down with Jesus and his disciples.
This conversion of one tax collector gave many men, those from his own profession and other sinners, an example of repentance and pardon. No sooner was he converted than Matthew drew after him a whole crowd of sinners along the same road to salvation.
It was Matthew who invited Jesus to dine with him, not the other way around. The 'sinners' were drawn to the one who was already converted.
A hypothetical....
There is a priest. He is asked to "co-preside" at the wedding of his nephew. It is to be held at a Lutheran Church and the woman is divorced. This will be her second marriage and the children resulting will be raised Lutheran.
Can the priest attend and "Witness" the wedding? One last thing, he baptized his nephew and saw him raised in the Faith.
That is a unique interpretation.