When they find one that will pass within 75 feet of the Earth, then I'll be concerned.
I recall a few years ago they discovered an asteroid that passed within half the distance of the moon or something. Pretty close.
Sad part is, they only discovered it AFTER it had passed by the Earth. “The sun was in my eyes!”
Not that it would made much of a difference if we had seen it earlier.