Just because a kid has bad parents doesn't mean the kid should miss out on at least learning how to read and write.
We also have the ghetto attitude that is against people getting an education, as if an education were only a white thing. That will have to be countered in a different manner.
Black slaves learned despite all that stood in their way including those things you mentioned with the added aspect of real, pernicious racism.
Drop government/force and you'd still get educated people. They'd really want it though and the rest would know enough to work at a skill.