The root of those guilty feelings is snobbery. Liberal “elites” call everyone else “hateful” or “racist,” but they are the ones who look down upon other people.
A snob is somebody who looks down on people and has zero guilt - he rather enjoy his status and has no sense of pity or guilt toward the “poor”. He is not racked by a sense of guilt and injustice the way elitist social justice warriors are.
He’s not on a mission to remake society into an egalitarian utopia.