I looked up my tree, and I had slave holding ancestors, but also had people involved in helping with the underground railway, so I guess I balance out.
I’m in the clear. My ancestors were WAY too poor to have owned slaves.
I don't have any direct ancestors who owned slaves, but a few distant uncles and cousins did. One branch of my tree is from the north, the other is from the south... I have union and confederate soldiers in my direct line. I suppose I balance, too.
Nothing to be ashamed of at all.