Posted on 05/16/2025 9:19:12 PM PDT by nickcarraway
Fears surrendering to GenAI makes humans less competitive
Science fiction author Neal Stephenson has suggested AIs should be allowed to fight other AIs, because evolution brings balance to ecosystems, but also thinks humans should stop using AI before it dumbs down our species.
Stephenson coined the term “metaverse” in his 1992 classic “Snow Crash”, and his 1999 epic “Cryptonomicon” envisioned digital currencies and the encryption needed to make them possible. The prescience of those works, and the cracking yarns he spins, mean he is in demand as both a novelist and thinker.
T. Rex had to worry about getting gored in the belly by Triceratops. By training AIs to fight we can perhaps preserve a healthy balance in the new ecosystem In the latter capacity he recently participated in what he described a “a panel discussion on AI as part of a private event in New Zealand.”
He’s since posted his opening remarks from the event, which open by noting understandable anxiety about the sudden arrival of generative AI.
Stephenson suggests remembering that we already share Earth with many non-human intelligences from the animal kingdom and have learned to get along with them.
“We’re used to thinking of them as being less intelligent than we are, and that’s usually not wrong,” he wrote, “but it might be better to think of them as having different sorts of intelligence, because they’ve evolved to do different things.”
His remarks offer ways to categorize non-human intelligences, and he ends up suggesting that the most useful AIs will be like sheepdogs – creatures that can do specific tasks better than a human. He thinks other AIs will be like dragonflies – largely oblivious to humans but doing certain things brilliantly well – while others will be like ravens or crows in that they are aware of humans but don’t care about us.
Stephenson thinks ChatGPT is like a lapdog, a class of intelligence that can’t survive without people and is “acutely tuned in to humans and basically exist to make life easier for us.”
The author thinks AIs which pose a threat to humans will also emerge.
“I am hoping that even in the case of such dangerous AIs we can still derive some hope from the natural world, where competition prevents any one species from establishing complete dominance,” he wrote. “Even T. Rex had to worry about getting gored in the belly by Triceratops, and probably had to contend with all kinds of parasites, infections, and resource shortages.
“By training AIs to fight and defeat other AIs we can perhaps preserve a healthy balance in the new ecosystem. If I had time to do it and if I knew more about how AIs work, I’d be putting my energies into building AIs whose sole purpose was to predate upon existing AI models by using every conceivable strategy to feed bogus data into them, interrupt their power supplies, discourage investors, and otherwise interfere with their operations.”
Stephenson doesn’t suggest that out of malice, instead articulating “a general belief that everything should have to compete, and that competition within a diverse ecosystem produces a healthier result in the long run than raising a potential superpredator in a hermetically sealed petri dish where its every need is catered to.”
Augmentation and amputation
The novelist admitted that AI-on-AI combat is unlikely in the short term, so turned his attention to other ways of curbing harms it might create.
To do so he invoked Marshall McLuhan’s observation that “every augmentation is also an amputation”.
He illustrated that concept by evoking conversations he has had with educators “who all report … their students use ChatGPT for everything, and in consequence learn nothing.
“We may end up with at least one generation of people who are like the Eloi in H.G. Wells’s The Time Machine, in that they are mental weaklings utterly dependent on technologies that they don’t understand and that they could never rebuild from scratch were they to break down,” Stephenson wrote, before asking “who is really the lapdog in a world full of powerful AIs?”
He thinks it’s easy to avoid becoming Eloi: All we need is “simple interventions such as requiring students to take examinations in supervised classrooms, writing answers out by hand on blank paper.
“We know this is possible because it’s how all examinations used to be taken. No new technology is required, nothing stands in the way of implementation other than institutional inertia, and, I’m afraid, the unwillingness of parents to see their children seriously challenged,” he wrote.
“In the scenario I mentioned before, where humans become part of a stable but competitive ecosystem populated by intelligences of various kinds, one thing we humans must do is become fit competitors ourselves. And when the competition is in the realm of intelligence, that means preserving and advancing our own intelligence by holding at arms length seductive augmentations in order to avoid suffering the amputations that are their price.” ®
Click here: to donate by Credit Card
Or here: to donate by PayPal
Or by mail to: Free Republic, LLC - PO Box 9771 - Fresno, CA 93794
Thank you very much and God bless you.
If Leftist are in charge, it will be like Star Trek’s A Taste Of Armageddon @ 1967.
This has happened before
There is nothing new under the sun
Hes a moron.
The AIs will decide we are not fit to survive with them.
And yeah that movie has been done. Terminator.
That statement is plainly nonsense. Evolutionary change more easily destroys parts of ecosystems leading to their failure and collapse. Evolutionary processes only promote changes that result in more offspring. Full stop. They are utterly unconcerned with whether a mutation leading to more offspring is causing harm to the environment, or has caused the extinction of other species that are playing a vital role in an ecosystem. Nor is it concerned with maintaining balance in an ecosystem - only in whether a given change results in the near term in more offspring.
The absence of any information feedback loop "informing" evolutionary changes that they are having harmful impacts on the environment is one of the fundamental flaws with evolutionary models. Nor is there any information feedback loop by which an ecosystem can be built in the first place. A primordial plant converting CO2 to oxygen is not going to evolve into a creature that does the exact opposite just because of some wishful thinking. The focus on producing more offspring is unrelated to such a goal.
Battlebots! I love that show!
“We may end up with at least one generation of people who are like the Eloi in H.G. Wells’s The Time Machine, in that they are mental weaklings utterly dependent on technologies that they don’t understand and that they could never rebuild from scratch were they to break down,” Stephenson wrote, before asking “who is really the lapdog in a world full of powerful AIs?”
One would have to be completely blind to not see this reality coming. This is why you do not feed the wildlife. They become dependent on you, get lazy, and stop hunting for themselves. They will starve themselves to death without you to feed them. This is exactly what is being done to us as a species right now...
Power and control through dependency. And we are happily embracing our own demise...
We are entering an era of Technofeudalism.
The AI that destroys the other AIs is the AI that is best at destroying things.
It doesn’t mean it is the best AI for us. It just means it is a certainty that it will destroy us faster than the other AIs would.
AI fighting AI
Right.... as if in the entire history of the world, wars always stay localized between the 2 contesting parties; no 3rd party has ever been dragged into another’s war.
If AI ever reaches true intelligence levels, a war will give birth to a computer version of Osama Bin Laden
Let’s say a mutation in a lettuce plant results in greater seed production and thus more surviving offspring for the lettuce, but also reduces the nitrogen fixation produced by the lettuce plant. Nitrogen fixation is a helpful process that provides benefits to the entire ecosystem. But the mutant lettuce plant doesn’t care that it has abandoned a process that benefits the entire ecosystem - it only “cares” that it is producing more offspring. That it may cause an ecological disaster a thousand years in the future is completely irrelevant to natural selections’ evaluation (so to speak) of a mutation. The notion that evolution leads to balanced ecosystems is complete nonsense. It _only_ cares about immediate increased offspring, the impact on the rest of the ecosystem be d*mned. As such mutations (whether “neutral” or guided by natural selection) are far, far more likely to disrupt and destroy existing ecological balances and processes than maintain or stabilize them.
Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.