The commonly used term for it back in the "Jim Crow" South was "reckless eyeballing."
And back then, too, only men of a certain, umm, persuasion would be accused of it.
Though today, it seems to apply more to "good looks" than "race."
Regards,
Yes, I agree, Even more surprising that my very Southern father had his attitudes about proper conduct. He said the same thing to me about staring at a huge black woman.