You’ve fallen into their trap, you’re now arguing the definition of racism. Tell them that regardless of what they call it, they want to treat people terribly simply due to their skin color.
I think it refuted them, because than their arguement of racism is shown to be not set in stone.