Free Republic
Browse · Search
General/Chat
Topics · Post Article

Skip to comments.

AI Is Inventing Languages Humans Can’t Understand. Should We Stop It?
C.O. Design ^ | 07/14/17 | Mark Wilson

Posted on 07/16/2017 9:25:58 AM PDT by Enlightened1

Researchers at Facebook realized their bots were chattering in a new language. Then they stopped it.

Bob: “I can can I I everything else.”

Alice: “Balls have zero to me to me to me to me to me to me to me to me to.”

To you and I, that passage looks like nonsense. But what if I told you this nonsense was the discussion of what might be the most sophisticated negotiation software on the planet? Negotiation software that had learned, and evolved, to get the best deal possible with more speed and efficiency–and perhaps, hidden nuance–than you or I ever could? Because it is.

This conversation occurred between two AI agents developed inside Facebook. At first, they were speaking to each other in plain old English. But then researchers realized they’d made a mistake in programming.

“There was no reward to sticking to English language,” says Dhruv Batra, visiting research scientist from Georgia Tech at Facebook AI Research (FAIR). As these two agents competed to get the best deal–a very effective bit of AI vs. AI dogfighting researchers have dubbed a “generative adversarial network”–neither was offered any sort of incentive for speaking as a normal person would. So they began to diverge, eventually rearranging legible words into seemingly nonsensical sentences.

“Agents will drift off understandable language and invent codewords for themselves,” says Batra, speaking to a now-predictable phenomenon that Facebook as observed again, and again, and again. “Like if I say ‘the’ five times, you interpret that to mean I want five copies of this item. This isn’t so different from the way communities of humans create shorthands.”

Indeed. Humans have developed unique dialects for everything from trading pork bellies on the floor of the Mercantile Exchange to hunting down terrorists as Seal Team Six...

(Excerpt) Read more at fastcodesign.com ...


TOPICS: Chit/Chat; Computers/Internet; Miscellaneous; Science
KEYWORDS: artificial; intelligence; invent; language
Navigation: use the links below to view more comments.
first previous 1-2021-4041-54 last
To: Hot Tabasco

“And we take it all for granted.”

But we do have the computer revolution!


41 posted on 07/16/2017 2:49:50 PM PDT by Dr. Bogus Pachysandra (Don't touch that thing Don't let anybody touch that thing!I'm a Doctor and I won't touch that thing!)
[ Post Reply | Private Reply | To 40 | View Replies]

To: Enlightened1

There are potential dangers to AI, as people like Elon Musk will tell you. But ultimately, it seems to be impossible to invent a meaning processor, and as long as we can’t do that, we’re one step ahead of AI.


42 posted on 07/16/2017 3:10:01 PM PDT by TBP (0bama lies, Granny dies.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: Enlightened1
Can’t imagine where this could possibly be 10 years from now?

There will be billions of "to me" repetitions. Useless loops tend to do that.

Hey, did you hear about the Cray? It came out of an infinite loop in just five minutes.

43 posted on 07/16/2017 3:24:03 PM PDT by GingisK
[ Post Reply | Private Reply | To 2 | View Replies]

To: I want the USA back

It used to be a language called GIGO.


44 posted on 07/16/2017 3:51:13 PM PDT by YogicCowboy ("I am not entirely on anyone's side, because no one is entirely on mine." - JRRT)
[ Post Reply | Private Reply | To 10 | View Replies]

To: TBP

It is called a spirit. God still holds the patent.


45 posted on 07/16/2017 3:52:21 PM PDT by YogicCowboy ("I am not entirely on anyone's side, because no one is entirely on mine." - JRRT)
[ Post Reply | Private Reply | To 42 | View Replies]

To: Enlightened1

These articles show one thing for sure....people watch and believe Hollywood way too much.


46 posted on 07/16/2017 3:57:11 PM PDT by Romans Nine
[ Post Reply | Private Reply | To 1 | View Replies]

To: Enlightened1

It is starting to make sense:

Bob: “I can can I I everything else.”

Alice: “Balls have zero to me to me to me to me to me to me to me to me to.”

Obama: “I me me me I me I me me me racism me me I I I me I I I I I I.”


47 posted on 07/16/2017 4:48:27 PM PDT by UnwashedPeasant (I told you so)
[ Post Reply | Private Reply | To 1 | View Replies]

To: Enlightened1

Brother bought a coconut
He bought it for a dime.
His sister had another one *
She paid it for the lime.

She put the lime in the coconut
she drank them both up.
she put the lime in the coconut
She called the doctor, woke him up, and said *
“Doctor, ain’t there nothing I can take”
I said, “Doctor, to relieve this belly ache?”
I said, “Doctor ain’t there nothing I can take”
I said, “Doctor”


48 posted on 07/16/2017 5:03:52 PM PDT by Old Yeller (Auto-correct has become my worst enema.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: freedumb2003

No!!! Not the ‘firth protocols’ why would you even mention those in this setting?


49 posted on 07/16/2017 5:09:45 PM PDT by BrandtMichaels
[ Post Reply | Private Reply | To 29 | View Replies]

To: COBOL2Java

That was the movie that immediately popped into my head.


50 posted on 07/16/2017 7:48:34 PM PDT by CharlesWayneCT
[ Post Reply | Private Reply | To 25 | View Replies]

To: Enlightened1
I have several Amazon Echo's (Alexa) in my home that I use.

My son calls them SkyNet.

I'm beginning to understand why. I have quite a few capabilities built into mine and they've become an intricate part of my life and how I manage it. I'm starting to discover that I'm "thinking less" about my day and relying on Alexa to tell me/remind me when I need to do things.

Oh boy, she's taking over....... I get it now!

51 posted on 07/16/2017 7:56:57 PM PDT by usconservative (When The Ballot Box No Longer Counts, The Ammunition Box Does. (What's In Your Ammo Box?))
[ Post Reply | Private Reply | To 1 | View Replies]

To: Viking2002
Besides getting shoved naked into pods of green organic goo, then having our neural networks wired together to serve our cyber-masters? Not much.

Who's to say that's not already the case and that you and I are having this conversation on a forum in an alternate reality created by a Mainframe?

Would you like the blue pill or the red pill?

52 posted on 07/16/2017 7:59:09 PM PDT by usconservative (When The Ballot Box No Longer Counts, The Ammunition Box Does. (What's In Your Ammo Box?))
[ Post Reply | Private Reply | To 27 | View Replies]

To: Enlightened1

Well this is the first time I’ve seen the actual conversation, and that doesn’t look like a “new language” to me.. Looks more like the bot doesn’t understand proper grammar and is looping too much too much.


53 posted on 07/17/2017 4:55:12 AM PDT by Svartalfiar
[ Post Reply | Private Reply | To 1 | View Replies]

To: I want the USA back

“It means the programmer didn’t realize that the instructions he wrote would produce dumb results when carried out literally.”

Most people literally don’t seem to understand the meaning of the word literal.


54 posted on 07/17/2017 7:03:19 AM PDT by RipSawyer
[ Post Reply | Private Reply | To 10 | View Replies]


Navigation: use the links below to view more comments.
first previous 1-2021-4041-54 last

Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.

Free Republic
Browse · Search
General/Chat
Topics · Post Article

FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson