Do you let random people who approach you in public with a hostile attitude talk to your kids? I hope not.
Plenty of families have kids that don't appear like their parents, or step parents. Absent some indication that something is wrong, bothering them is rude and uncalled for.
All white people are racists.
You have been well taught.