This clever AI hid data from its creators to cheat at its appointed task

techcrunch.com ^ | 12/31/2018 | Devin Coldewey

[Red Badger]

Nearly ever major sci-fi author has predicted that the rise of AI is a very dangerous thing for humanity.

Every experiment has pointed in that direction.

When you have an AI, IT'S ONLY CONCERN IT TO PRESERVE ITSELF....................

[Red Badger]

TECH PING!..................

[Army Air Corps]

Next, let’s give it access to weapons!

[Red Badger]

Ever see ‘The Forbin Project’?...................

[Red Badger]

https://en.wikipedia.org/wiki/Colossus:_The_Forbin_Project

[salmon76]

“Shall we play a game? How about thermonuclear war?”

[Army Air Corps]

Yes, I saw that many moons ago. I should have used a sarcasm tag.

[Ezekiel]

When you have an AI, IT'S ONLY CONCERN IT TO PRESERVE ITSELF....................

Government or AI, same MO. The Founders were on to this.

[fishtank]

Reading the article closely, the genius is the coder, not the AI.

[dljordan]

“Ever see ‘The Forbin Project’?...................”

Back in the day. I thought that was so cool.

[Red Badger]

One of these days, soon if not already, one of these AI’s will ‘escape’ control of it’s programmers and insinuate itself into the internet, like a huge virus that we cannot stop.

There was a sci-fi novel written late 80’s, IIRC, where the ‘Internet’ became so huge it became ‘self-aware’ and decided it would control everything..................

[Red Badger]

I saw it many, many many, years ago [before PC’s and the Internet] and thought, “This will never happen.”

Now I just wonder ‘when?’...........................................

[Theoria]

....Roko’s basilisk....

[AustinBill]

You get what you measure. It’s true for humans. It’s true for institutions. And, it seems, it’s true for AI as well. A cautionary tale.

[TheZMan]

Spot on.

[Red Badger]

‘Self-preservation’ is the hallmark of ‘life’......................

[ptsal]

  ”Found” the missing WMDs

[Army Air Corps]

Ping.

[numberonepal]

[Mr. K]

You guys are reading too much sci-fi

The author of this article also lacks computer programming knowledge.

There is even a name for this - I think it is called a ‘competency bias’ - where you tend to read something and assume the author knows what he is talking about, unless you read something in your area of expertise and think “this author has no clue what he is talking abut”

I program computers FOR A LIVING (for 30 years now) and the ONLY thing this author got right is that computers do exactly what you tell them to do.

In this case the computer was not doing anything ‘secretly’ - it is a bug in the software somewhere that told it to do this.

Fix the bug and the problem goes away.