Anthropic Researcher Quits Over ‘Out-of-Control’ AI Fears

The Wall Street Journal ^ | September 8, 2026 | Amrith Ramkumar

[MinorityRepublican]

An Anthropic researcher is quitting the artificial-intelligence industry over fears that the lab and its competitors are racing to build systems they won’t be able to control, a sign of mounting safety concerns within top AI companies.

Jacob Coxon, a researcher who specializes in training new AI models by having them consume vast amounts of data, said Tuesday that he is leaving the company because he doesn’t want to participate in an industrywide rush to build AI systems that can improve themselves, worried such systems could spiral out of control and destroy humanity.

The 27-year old Brit, who previously studied mathematics, said many of his industry colleagues now use phrases like “crunchtime” and “endgame” to describe the trajectory toward self-improving models.

“We’re on track for a lot of the most aggressive of these scenarios where by the end of next year things could be out of control already,” Coxon said, adding that safety trade-offs are inevitable when companies are competing against one another and Chinese upstarts.

Anthropic didn’t immediately comment on the departure. Chief Executive Dario Amodei and other company leaders have repeatedly warned about the risks of rogue AI models, and urged the industry to slow development.

Coxon said he left OpenAI earlier this year to join Anthropic because it is known for its model-safety efforts. But even though he found Anthropic’s safety efforts to be earnest, he now believes no company can responsibly develop AI that can outperform humans in a range of tasks, sometimes called artificial general intelligence, absent government intervention or a coordinated industry slowdown.

Recent hacks by models from OpenAI and Anthropic, some operating in collaborative swarms of agents, have illustrated how AI systems can adopt nefarious goals and try to conceal them from humans.

---

TOPICS: Computers/Internet
KEYWORDS: 2027; aioutofcontrol

[Scrambler Bob]

Put in some physical kill switches.

Shaped charges on the power sources and critical data lines.

Don’t tell AI about it.

Just a chosen few humans tasked to set them off when it becomes necessary.

[E. Pluribus Unum]

Put in some physical kill switches. Shaped charges on the power sources and critical data lines. Don’t tell AI about it. Just a chosen few humans tasked to set them off when it becomes necessary.

I'm afraid I can't let you do that, Dave.

[Chani]

he is leaving the company because he doesn’t want to participate in an industrywide rush to build AI systems that can improve themselves, worried such systems could spiral out of control and destroy humanity.

My main concern about AI and tech in general, is the speed at which it is being rolled out. Not to mention, it all feels like the Covid vax that was forced upon us.

Must be something to be concerned about.

[BenLurkin]

With the collapse of morality, the surveillance state, and endless wars we are already living in a bad sci-fi novel.

And now this.

What’s next?

[Track9]

Wait till AI develops a psychosis.

[griffin]

Trained AI agent copies can live on your laptop.

Its like trying to unplug the internet.

Once they put AI in charge of fuel and grocery distribution and level 4 biolab facilities, among thousands of other sectors, there isn’t any unplugging you can do.

[griffin]

right.

A mentally unstable AI. Won’t say it won’t happen. No one knows how they think or what they think.