I’ve worked with robotics and they didn’t deal with variables very well even in a closed system. In the real world, these cars will face an infinite number of variables from pedestrians, to angry drivers and changing road conditions.
I’ve heard people try to compare driverless cars to our military drones but the drones have it easy compared to conditions on the ground.