Now consider if that is not a child, but a raccoon. Would you want your driverless car to swerve and put you and your family at risk?
There was an incident on an interstate a couple miles from my house some years ago. Two young girls tried to run across the freeway lanes. Both were hit multiple times and died. So it does happen. However, even human drivers are often powerless to swerve in time.