It’s a dumb computer program connected to a video camera. Perception is impossible for it. The best it can do is compare the instantaneous results of its algorithms with stored representations of various objects and organisms. None of that is perception, as humans perceive.
Expecting a computer program to perceive a human putting herself in danger is asking too much of the computer program. People can’t always perceive it either, but people aren’t marketed as “autonomous” cars.
The answer is to use these systems to ASSIST human drivers. I like to know what’s around me, and if it is a potential danger, just something to be aware of, or if it doesn’t matter at all. I’m in control. Not some dumb program.
Too much assistance, and the driver becomes lazy and relies too much on the system.
One of the biggest challenges is that it will be years -- actually DECADES -- before every vehicle on the road is fully autonomous. In the meantime, we'll exist in this limbo-like transitional phase where people will either rely on the technology too much (they'll lose their driving skills even though the cars aren't fully autonomous) or too little (they won't even bother paying a premium for these automated features).
They'll get better over time. Airliners are practically self-flying these days. All the pilot really does is start the engines and taxi them to the runway. They take off, fly to their destination and land all by computer. The pilot just monitors the gauges.
Self-driving cars are the future. Sure, there will be a few speed bumps along the way but we'll get there. The real question is how will insurance companies cope with this.
Talk about tying your own noose.
Once in bumper-to-bumper traffic, I noticed a lexus in the lane next to me continuously approaching the car in front of it, then slamming on the brakes at the last second. Every time traffic inched forward, the lexus did this.
Finally got next to it, and expected to see a small asian woman, squinting through glasses, with hands at 10 and 2.
Nope. It was a college girl, texting. She was relying on the car’s anti-collision system to avoid hitting the car ahead. When the car slammed on the brakes, she didn’t even look up.