From the author's point of view, you still have benefited from your parents' (and previous generation's) accumulated wealth.
Even though you started out on your own, the 'safety net' was still there.
At the time there wasn’t much at all. They has an 800 sq. foot house with 2 bed rooms and one bath room. Indeed, they were wallowing in ill-gotten white man’s wealth.