The UK is a “giver” in this relationship. The countries complaining about the UK leaving are “takers” in the relationship. It is as simple as that.
Welfare recipients always threaten terrible consequences if their unearned money is threatened.
Remaining in the EU is, for England, akin to “paying the Dane Geld”, as Kipling so accurately put it.