I also grew up poor, as did my wife, and we did very well. My parents couldn't afford to buy us books (five of us kids). So we used the library for our reading. My dad did buy an encyclopedia set, which we heavily relied on for our learning. Back then there were few distractions, no gadgets. With the proliferation of gadgets today, I see that as problematic in improving kids reading skills.
I have a friend that was born on a farm in the midwest around 1950. His parents didn't get indoor plumbing until after he moved out. He turned OK and makes a fairly good living..
The idea that parents have to have an all consuming interest in what their kids are doing in school for their children to succeed is bogus.