Basically I thinks it boils down to the universe is HUGE and just doesn’t care if 1 person somehow becomes “impossible”. Billions of people on the planets, billions of planets in the galaxy, billions of galaxies in the universe. 1 person goes back in time and kills their grandfather, so what. It’s like a physically impossible grain of sand on the beach, who’s gonna notice?
And the vast majority of it is empty space.