His dad did work in a mill but was a manager and well paid.
In all seriousness, where I grew up, managers in any business were rich yuppie scum. I'm not kidding. He didn't grow up poor at all, IMHO.