I would agree with you ONLY if you took the opportunity of a family gathering to discuss the sinful nature of their relationship with them and ask them to change their ways.
If you view this as being preachy or offensive, then your example of Jesus sitting down with tax collectors is irrelevant.
I agree with you.