The bigger question: if a NEO shaves us, does it take some of our atmosphere with it? Of course it does.
The amount would be miniscule, unless the object were big enough to also warp the crust of the Earth, in which case, we wouldn’t be too worried about atmosphere. :’)