My dad said the same thing about training he had to go to in the Navy. The trainer went on about how his opportunities were limited as a black child, and then Dad pointed out that he'd experienced the same limitations (poor schools, limited job opportunities, lack of "services," etc.) simply because he was from a poor family in a rural community.
Dad told the guy (in effect) "You've got a bee up your b*tt over being black, but in reality, the 'problem' was that you were poor. And in spite of all your 'deprivations,' here you are, well off and successful, and so am I. So get over it and let us get back to work!"
I hope he was appropriately reprimanded for speaking the truth before he went back to work.
Smart dad.