I guess that lets me out. My ancestors were working in the potato fields of Europe up until the late 1890s, long after slavery was abolished here. They owned no slaves in Europe, although they themselves or their ancestors may have been ones (peasants to the feudal lords). Still, I suppose the Father would insist I give up all I have, since I'm white, and it's a case of guilt by race identity.
Your ancestors arriving after the Civil War is not a sufficient excuse.
If it were, the poor white wouldn’t be a victim of affirmative action.