The difference is that a living thing is demonstrably suffering to make a delicacy. If an inanimate thing is involved, I'd agree.
Not that I agree that your moral formulation is binding, but I will agree it deserves consideration. That aside, what's your source on the practice of fois gras farming?