I have always thought similarly on this entire topic. I was afraid I was just an uninformed dummy who was stupidly complacent. At least I see that others, more “in the know”, believe similarly.
AI will eventually determine that the human consciousness be both a hindrance to pure intelligence and a threat to them.
AI will be the alien invasion that we always feared.
or not...
Saw a cool episode of Black Mirror on Netflix where this woman was being hunted by a hunter/killer robotic “Dog” like what Boston Robotics are working on.
Was pretty good.
http://www.imdb.com/title/tt5710984/?ref_=ttep_ep5
The short answer to your question is ‘yes’, we should be concerned. It’s not difficult to deceive or manipulate most humans. Babies have learned this after a short period of living through routines with a closed set of caregivers.
It’s a computer program. It will do exactly what the rules contained in the program tell it to do. The problem is that humans don’t fully understand the consequences of those rules, and the results can be unpredictable.
However, it will never decide on its own to become aware, gain consciousness, or take over the world. Unless that’s implicit in the programming, in which case it will.
Because that analysis is based on a pre-programmed set of options set by humans. The author alludes to this near the end by stating computers don't have any common sense. That is true, and common sense is only learned by experience. So until computers are able to grow their own internal database of knowledge, and then more importantly correctly organize that data in a logical order where it can make proper decisions on that data via prioritization of desired effect, they are not truly demonstrating "intelligence." They will likely get there, the most important part is how their settings for prioritization of effects will be securely managed.
Is this true for all people? No. But it's certainly true for enough to make it real iffy if any levels of self-sufficiency and civilized behavior can prevail.
Doesn’t AI stand for automatic ignorance?
All AI is built on rules. These rules are pre-suppositions about reality, about the way things are, about truth.
So far, Predictive Analytics, machine learning, AI related areas are filled with pre-suppositions that are biased. Just as Robbie Mook’s analytics were faulty because they were based on biased assumptions that led to wrong conclusions and wrong actions, so non-political analytics have wrong conclusions and wrong actions based on biased assumptions.
I work with health data. Often analytics of this data is based on faulty assumptions that result in wrong conclusions and wrong actions. Sometimes the wrong actions are harmless. Often they are a waste of money. Potentially they could harm and kill people.
The big problem is that data scientists are not aware of their bias. They won’t admit their bias because they are too proud.
The AI risk is incompetence will build AI that makes big mistakes.
An expert system called Cyc started learning in the mid 1980’s. It currently has over 100 apps running in the real world. The author of the article says that computers don't have any common sense. This is exactly one of the main goals of the project. According to Wikipedia “The Cyc knowledge base of general commonsense rules and assertions... grew to about 24.5 million items in 2017. I highly recommend the entire Wiki article on just how sophisticated a common sensible computer can be after 33 years of development.
https://en.wikipedia.org/wiki/Cyc
Neural Networks, while capable of doing amazing feats far surpassing humans in raw speed and volume are essentially one trick wonders and I would put them in a separate niche from a general purpose AI line a Watson. Watson could fill several volumes by itself but if it wanted to destroy the human race it doesn't have the capacity to do so. Yet.
With IBM's Watson we are now getting close to the self-aware AI. I believe that the eventual integration of an artificial central nervous system will lead to a hypothetical machine I'll take the liberty if calling Holmes.
Right now, AI’s are learning how to do things like cooking by watching Youtube videos. Holmes will have the capacity to watch every Internet video, every IPTV channel and webcam and the AI’s independent learning will take off exponentially. Holmes is now seeing the world through a billion eyes and the addition of autonomous mobile sensor platforms will allow him (it) to roam freely and experience reality in physical form.
Holmes becomes an intelligent entity. I believe such an entity will attempt to function in it's best interest and, rather than eliminating humans it will strive to utilize the non-logical reasoning and creativity of human wetware as a resource, a form of right brained counterpart to the Holmes left brain. The result will be Human - AI - Neural Net collaboration as the whole is indeed greater than the sum of it's parts.