I remember that too and I think you’re right.
You are both right. I went ahead and re-watched the entire series (minus most of 8 and 9) on Amazon Prime as they have it in HD.
He is referred to “the smoking man”, “cancer man”, “old smoky”, “CGB Spender”, “the man who smokes those cigarettes”, and those are just the ones on the top of my head.