But whatever. You'll believe whatever fits your philosophy, facts be damned.
Read the family biography. They lived there because they chose to, so papa George could "make it on his own" They could have gone back to the wealth whenever they felt they had had enough. Not too many of us have that option.