Free Republic

An Anthropic researcher is quitting the artificial-intelligence industry over fears that the lab and its competitors are racing to build systems they won’t be able to control, a sign of mounting safety concerns within top AI companies. Jacob Coxon, a researcher who specializes in training new AI models by having them consume vast amounts of data, said Tuesday that he is leaving the company because he doesn’t want to participate in an industrywide rush to build AI systems that can improve themselves, worried such systems could spiral out of control and destroy humanity. The 27-year old Brit, who previously studied...

An artificial intelligence researcher who left OpenAI to join Anthropic has decided to leave the industry, accusing both US companies of "playing with our lives" in the race to develop AI models capable of self-improvement.Jacob Coxon, 27, spent the past three years pretraining AI models, first at OpenAI and then, this year, at its rival Anthropic, which he considered more cautious in its approach. Pretraining is the stage where AI models absorb vast quantities of data."Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives," Coxon said on Tuesday."The people building AI earnestly...

A researcher for one of the largest and most valuable artificial intelligence companies has publicly quit — while raising the alarm that the technology “could kill us all by the end of the decade.” Jacob Coxon, who has performed pre-training research at Anthropic and OpenAI for the last three years, posted on a wildly viral X thread that “neither company is acting responsibly.” “They are racing straight to self-improving superintelligence and gambling with our lives,” he wrote late Tuesday, with others from the company backing his terrifying warning. “Do not underestimate the power of this technology. These will soon be...