This is a sad kind of thing that says, because you can damn something that has a superficial similarity to something else you have been deeming good, you have to back off from that something else too.
We might need to accommodate people of weak faith. If a Christmas tree offended someone who did not fully understand, I would never force a Christmas tree on that person.
But it’s another thing for the offended person to go around telling us we’re all wrong because he’s offended. A better case needs to be made.
You are correct. It is the privilege of the mature to defer to another’s weak conscience (while owning their freedom in Christ). Paul lays it out so beautifully. Know who you are and yet defer for love’s sake!