Free Republic
Browse · Search
General/Chat
Topics · Post Article

Skip to comments.

Sci-fi author Neal Stephenson wants AIs fighting AIs so those most fit to live with us survive
The Register ^ | Fri 16 May 2025 | iconSimon Sharwood

Posted on 05/16/2025 9:19:12 PM PDT by nickcarraway

Fears surrendering to GenAI makes humans less competitive

Science fiction author Neal Stephenson has suggested AIs should be allowed to fight other AIs, because evolution brings balance to ecosystems, but also thinks humans should stop using AI before it dumbs down our species.

Stephenson coined the term “metaverse” in his 1992 classic “Snow Crash”, and his 1999 epic “Cryptonomicon” envisioned digital currencies and the encryption needed to make them possible. The prescience of those works, and the cracking yarns he spins, mean he is in demand as both a novelist and thinker.

T. Rex had to worry about getting gored in the belly by Triceratops. By training AIs to fight we can perhaps preserve a healthy balance in the new ecosystem In the latter capacity he recently participated in what he described a “a panel discussion on AI as part of a private event in New Zealand.”

He’s since posted his opening remarks from the event, which open by noting understandable anxiety about the sudden arrival of generative AI.

Stephenson suggests remembering that we already share Earth with many non-human intelligences from the animal kingdom and have learned to get along with them.

“We’re used to thinking of them as being less intelligent than we are, and that’s usually not wrong,” he wrote, “but it might be better to think of them as having different sorts of intelligence, because they’ve evolved to do different things.”

His remarks offer ways to categorize non-human intelligences, and he ends up suggesting that the most useful AIs will be like sheepdogs – creatures that can do specific tasks better than a human. He thinks other AIs will be like dragonflies – largely oblivious to humans but doing certain things brilliantly well – while others will be like ravens or crows in that they are aware of humans but don’t care about us.

Stephenson thinks ChatGPT is like a lapdog, a class of intelligence that can’t survive without people and is “acutely tuned in to humans and basically exist to make life easier for us.”

The author thinks AIs which pose a threat to humans will also emerge.

“I am hoping that even in the case of such dangerous AIs we can still derive some hope from the natural world, where competition prevents any one species from establishing complete dominance,” he wrote. “Even T. Rex had to worry about getting gored in the belly by Triceratops, and probably had to contend with all kinds of parasites, infections, and resource shortages.

“By training AIs to fight and defeat other AIs we can perhaps preserve a healthy balance in the new ecosystem. If I had time to do it and if I knew more about how AIs work, I’d be putting my energies into building AIs whose sole purpose was to predate upon existing AI models by using every conceivable strategy to feed bogus data into them, interrupt their power supplies, discourage investors, and otherwise interfere with their operations.”

Stephenson doesn’t suggest that out of malice, instead articulating “a general belief that everything should have to compete, and that competition within a diverse ecosystem produces a healthier result in the long run than raising a potential superpredator in a hermetically sealed petri dish where its every need is catered to.”

Augmentation and amputation

The novelist admitted that AI-on-AI combat is unlikely in the short term, so turned his attention to other ways of curbing harms it might create.

To do so he invoked Marshall McLuhan’s observation that “every augmentation is also an amputation”.

He illustrated that concept by evoking conversations he has had with educators “who all report … their students use ChatGPT for everything, and in consequence learn nothing.

“We may end up with at least one generation of people who are like the Eloi in H.G. Wells’s The Time Machine, in that they are mental weaklings utterly dependent on technologies that they don’t understand and that they could never rebuild from scratch were they to break down,” Stephenson wrote, before asking “who is really the lapdog in a world full of powerful AIs?”

He thinks it’s easy to avoid becoming Eloi: All we need is “simple interventions such as requiring students to take examinations in supervised classrooms, writing answers out by hand on blank paper.

“We know this is possible because it’s how all examinations used to be taken. No new technology is required, nothing stands in the way of implementation other than institutional inertia, and, I’m afraid, the unwillingness of parents to see their children seriously challenged,” he wrote.

“In the scenario I mentioned before, where humans become part of a stable but competitive ecosystem populated by intelligences of various kinds, one thing we humans must do is become fit competitors ourselves. And when the competition is in the realm of intelligence, that means preserving and advancing our own intelligence by holding at arms length seductive augmentations in order to avoid suffering the amputations that are their price.” ®


TOPICS: Books/Literature; Computers/Internet; Conspiracy
KEYWORDS: ai; aislugfest; aiwars; moarai

Click here: to donate by Credit Card

Or here: to donate by PayPal

Or by mail to: Free Republic, LLC - PO Box 9771 - Fresno, CA 93794

Thank you very much and God bless you.


1 posted on 05/16/2025 9:19:12 PM PDT by nickcarraway
[ Post Reply | Private Reply | View Replies]

To: nickcarraway

If Leftist are in charge, it will be like Star Trek’s A Taste Of Armageddon @ 1967.


2 posted on 05/16/2025 9:23:56 PM PDT by Deaf Smith (When a Texan takes his chances, chances will be taken that's for sure.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: nickcarraway

This has happened before

There is nothing new under the sun


3 posted on 05/16/2025 9:31:29 PM PDT by algore
[ Post Reply | Private Reply | To 1 | View Replies]

To: nickcarraway

Hes a moron.

The AIs will decide we are not fit to survive with them.

And yeah that movie has been done. Terminator.


4 posted on 05/16/2025 10:35:02 PM PDT by Secret Agent Man (Gone Galt; not averse to Going Bronson.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: nickcarraway
because evolution brings balance to ecosystems

That statement is plainly nonsense. Evolutionary change more easily destroys parts of ecosystems leading to their failure and collapse. Evolutionary processes only promote changes that result in more offspring. Full stop. They are utterly unconcerned with whether a mutation leading to more offspring is causing harm to the environment, or has caused the extinction of other species that are playing a vital role in an ecosystem. Nor is it concerned with maintaining balance in an ecosystem - only in whether a given change results in the near term in more offspring.

The absence of any information feedback loop "informing" evolutionary changes that they are having harmful impacts on the environment is one of the fundamental flaws with evolutionary models. Nor is there any information feedback loop by which an ecosystem can be built in the first place. A primordial plant converting CO2 to oxygen is not going to evolve into a creature that does the exact opposite just because of some wishful thinking. The focus on producing more offspring is unrelated to such a goal.

5 posted on 05/17/2025 12:38:48 AM PDT by EnderWiggin1970
[ Post Reply | Private Reply | To 1 | View Replies]

To: nickcarraway

Battlebots! I love that show!


6 posted on 05/17/2025 1:28:59 AM PDT by Stosh
[ Post Reply | Private Reply | To 1 | View Replies]

To: nickcarraway

“We may end up with at least one generation of people who are like the Eloi in H.G. Wells’s The Time Machine, in that they are mental weaklings utterly dependent on technologies that they don’t understand and that they could never rebuild from scratch were they to break down,” Stephenson wrote, before asking “who is really the lapdog in a world full of powerful AIs?”

One would have to be completely blind to not see this reality coming. This is why you do not feed the wildlife. They become dependent on you, get lazy, and stop hunting for themselves. They will starve themselves to death without you to feed them. This is exactly what is being done to us as a species right now...

Power and control through dependency. And we are happily embracing our own demise...


7 posted on 05/17/2025 4:08:18 AM PDT by Openurmind (AI - An Illusion for Aptitude Intrusion to Alter Intellect. )
[ Post Reply | Private Reply | To 1 | View Replies]

To: nickcarraway

We are entering an era of Technofeudalism.


8 posted on 05/17/2025 4:23:31 AM PDT by Openurmind (AI - An Illusion for Aptitude Intrusion to Alter Intellect. )
[ Post Reply | Private Reply | To 1 | View Replies]

To: EnderWiggin1970
The absence of any information feedback loop "informing" evolutionary changes that they are having harmful impacts on the environment is one of the fundamental flaws with evolutionary models.

Huh?
9 posted on 05/17/2025 4:52:55 AM PDT by ComputerGuy
[ Post Reply | Private Reply | To 5 | View Replies]

To: Secret Agent Man

The AI that destroys the other AIs is the AI that is best at destroying things.
It doesn’t mean it is the best AI for us. It just means it is a certainty that it will destroy us faster than the other AIs would.


10 posted on 05/17/2025 5:25:34 AM PDT by Doctor Congo
[ Post Reply | Private Reply | To 4 | View Replies]

To: nickcarraway

AI fighting AI
Right.... as if in the entire history of the world, wars always stay localized between the 2 contesting parties; no 3rd party has ever been dragged into another’s war.

If AI ever reaches true intelligence levels, a war will give birth to a computer version of Osama Bin Laden


11 posted on 05/17/2025 7:37:34 AM PDT by VetoBill
[ Post Reply | Private Reply | To 1 | View Replies]

To: ComputerGuy

Let’s say a mutation in a lettuce plant results in greater seed production and thus more surviving offspring for the lettuce, but also reduces the nitrogen fixation produced by the lettuce plant. Nitrogen fixation is a helpful process that provides benefits to the entire ecosystem. But the mutant lettuce plant doesn’t care that it has abandoned a process that benefits the entire ecosystem - it only “cares” that it is producing more offspring. That it may cause an ecological disaster a thousand years in the future is completely irrelevant to natural selections’ evaluation (so to speak) of a mutation. The notion that evolution leads to balanced ecosystems is complete nonsense. It _only_ cares about immediate increased offspring, the impact on the rest of the ecosystem be d*mned. As such mutations (whether “neutral” or guided by natural selection) are far, far more likely to disrupt and destroy existing ecological balances and processes than maintain or stabilize them.


12 posted on 05/17/2025 8:18:28 AM PDT by EnderWiggin1970
[ Post Reply | Private Reply | To 9 | View Replies]

Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.

Free Republic
Browse · Search
General/Chat
Topics · Post Article

FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson