Replies

Interesting article. I have a professional interest in autonomous vehicle development, and I've been warning about the risks associated with them for years. I've determined that the core of the problem is really simple:

1. Automation is fine when it is used to replace human functionality. A computer or machine can always be designed to do a predictable function better, faster and/or more precisely than a human.

2. The danger comes when automation is used to replace human judgement. Driving is a perfect example of this. Most of the operational aspects of a vehicle that can be upgraded to replace the human function have already been automated. Now we have industry operating in a realm where they are trying to replace human judgement, and it isn't working.

Good explanation of the underlying problem. You’re dead on.

In arguments with other developers I’ve tended to attack it from a coding perspective, such as, “how would the algorithm handle driving down a road with no stripes?”

“If a driver in the left lane needs to get into the right lane by merging between 2 autonomous cars, will they kindly let him in by slowing down / splitting the distance? And what if there’s a semi behind the 2nd autonomous car, wherein a human driver would say, ‘tough luck’ and not let the driver change lanes?”

You can come up with countless examples of “judgement” vs. “functionality”.

This is a very good, fact-based, objective article.

It gives a straight-forward description of the human and computer actions that led to the death of Elaine Herzberg (though I would add she foolishly walked her bike in dark section of the road. Did she not see the headlights coming at her? Did she believe she had enough time to cross the street? Did she believe the car would see her and slow down or swerve to miss her? I have no idea what she was thinking as her actions showed complete lack of situational awareness or disregard of her actions). Computers can't predict irrational human behavior. Neither can people.

I would love a car with AUGMENTED driving and safety features BUT I would never want one with total computer control. I want a wheel and brakes under my control.

The driver was also a fool for not paying attention. As I understand it the car was in testing mode and he/she was supposed to be paying attention not looking at his/her phone.

This incident shows computers (as yet or if ever) cannot be programmed to anticipate every situation.

Throw in poor judgment by people and unforeseen situations and human judgment becomes critical.