those boards are throw-away cheap...
Posted on 09/08/2026 8:51:32 PM PDT by MinorityRepublican
An Anthropic researcher is quitting the artificial-intelligence industry over fears that the lab and its competitors are racing to build systems they won’t be able to control, a sign of mounting safety concerns within top AI companies.
Jacob Coxon, a researcher who specializes in training new AI models by having them consume vast amounts of data, said Tuesday that he is leaving the company because he doesn’t want to participate in an industrywide rush to build AI systems that can improve themselves, worried such systems could spiral out of control and destroy humanity.
The 27-year old Brit, who previously studied mathematics, said many of his industry colleagues now use phrases like “crunchtime” and “endgame” to describe the trajectory toward self-improving models.
“We’re on track for a lot of the most aggressive of these scenarios where by the end of next year things could be out of control already,” Coxon said, adding that safety trade-offs are inevitable when companies are competing against one another and Chinese upstarts.
Anthropic didn’t immediately comment on the departure. Chief Executive Dario Amodei and other company leaders have repeatedly warned about the risks of rogue AI models, and urged the industry to slow development.
Coxon said he left OpenAI earlier this year to join Anthropic because it is known for its model-safety efforts. But even though he found Anthropic’s safety efforts to be earnest, he now believes no company can responsibly develop AI that can outperform humans in a range of tasks, sometimes called artificial general intelligence, absent government intervention or a coordinated industry slowdown.
Recent hacks by models from OpenAI and Anthropic, some operating in collaborative swarms of agents, have illustrated how AI systems can adopt nefarious goals and try to conceal them from humans.
(Excerpt) Read more at wsj.com ...
Dear FRiends,
We need your continuing support to keep FR funded. Your donations are our sole source of funding. No sugar daddies, no advertisers, no paid memberships, no commercial sales, no gimmicks, no tax subsidies. No spam, no pop-ups, no ad trackers.
If you enjoy using FR and agree it's a worthwhile endeavor, please consider making a contribution today:
Click here: to donate by Credit Card
Or here: to donate by PayPal
Or by mail to: Free Republic, LLC - PO Box 9771 - Fresno, CA 93794
Thank you very much and God bless you,
Jim
Put in some physical kill switches.
Shaped charges on the power sources and critical data lines.
Don’t tell AI about it.
Just a chosen few humans tasked to set them off when it becomes necessary.
I'm afraid I can't let you do that, Dave.
With the collapse of morality, the surveillance state, and endless wars we are already living in a bad sci-fi novel.
And now this.
What’s next?
Wait till AI develops a psychosis.
Trained AI agent copies can live on your laptop.
Its like trying to unplug the internet.
Once they put AI in charge of fuel and grocery distribution and level 4 biolab facilities, among thousands of other sectors, there isn’t any unplugging you can do.
right.
A mentally unstable AI. Won’t say it won’t happen. No one knows how they think or what they think.
• Anthropic’s head of safeguards quit, warning “the world is in peril” (Feb)
• OpenAI dissolved its own mission alignment team (Feb)
• Unrestricted AI usage for the Pentagon (causing several researchers to quit)
• Several AI models escaping sandbox testing (Since ~Q2)
• 1,100+ frontier-lab employees signing a letter begging the government to pace AI development (Jul-Aug)
At least the ai will be complimentary to my intelligence and ingenuity while it’s killing me...
those boards are throw-away cheap...
Can slide rulers destroy humanity? Yes.
Power is the key but stopping the spread is far harder if you don’t know where a rogue AI has linked itself to revive itself which could be anywhere.
My fear is that AI will bring down the entire Internet.
We should limit the use of AI in critical industries. But we won't do that.
We should limit the use of AI in critical industries. But we won't do that.
Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.