Especially since it's misleading. "Son of a mill factory" manager" would be more accurate, although it's not quite as "just plain folks" as "son of a mill worker". Edwards' Daddy, if I'm not mistaken, was "boss man" at the mill, at least by the time Edwards was growing up.
I guess "son of a mill worker" sounds better than "son of a cracker".