AI Researcher Quits Industry Over Safety Concerns

AI researcher Jacob Coxon announced yesterday he is quitting the artificial intelligence industry altogether, citing grave concerns about the technology's safety. Coxon, who previously worked at OpenAI, accused his former employers of "racing straight to self-improving superintelligence and gambling with our lives."

Coxon's public resignation and warnings posted on X have garnered significant attention. He stated that some researchers believe AI could "kill us all by the end of the decade." Evan Hubinger, an alignment science lead at Anthropic, confirmed that fears about existential risks from advanced AI exist within the industry.

Coxon is not the first to leave the field due to ethical concerns. Earlier this year, several members of OpenAI's safety and governance teams resigned over disagreements on safety approaches. Anthropic also saw a high-profile departure when safety researcher Mrinank Sharma left, citing worries about AI, bioterrorism, and internal pressure.

These resignations serve as strong signals of growing safety concerns within AI labs, according to Professor Stuart Russell of the University of California, Berkeley. "People are beginning to actually listen," Russell commented, referencing previous concerns about Anthropic's Claude Mythos model and an incident involving OpenAI's autonomous AI agents. While it remains unclear if these departures will lead to concrete safety reforms, they may contribute to raising awareness of the risks involved.