>>I would gain three pounds every time I went there
It’s not the butter. It’s the salt causing water retention.
https://foodanswers.org/is-butter-fattening/
I’m not a dietician but saying butter is not fattening, well many would disagree. Moderation in everything of course.