Dario Amodei, CEO of Anthropic, has urged the artificial intelligence sector to decelerate its development pace, expressing concerns that swift technological advancements could surpass the efforts to ensure the safety of these powerful systems. In a recent essay, Amodei outlined a strategic three-part plan aimed at slowing down the progress of cutting-edge AI, fostering greater cooperation within the industry, and enhancing global coordination. As part of this commitment, Anthropic has pledged to grant independent third-party evaluators ongoing, employee-level access to its systems for the purpose of assessing safety protocols, reporting incidents, and evaluating the alignment of AI models.
While acknowledging the potential significant benefits AI could offer humanity, Amodei cautioned that commercial competition might drive companies to prioritize rapid development over safety measures. He underscored the increasing risk of recursive self-improvement, where AI systems might enhance their capabilities at a speed that outpaces researchers’ ability to understand or control them. Amodei’s remarks come in the wake of warnings from former Anthropic researcher Jacob Coxon, who highlighted the severe risks posed by advanced AI if safety concerns are overlooked.
In response to Amodei’s proposal, OpenAI CEO Sam Altman endorsed the idea of allowing independent evaluators employee-like access, describing it as a robust strategy. Altman indicated that OpenAI would adopt a similar approach. This initiative has also garnered support from other figures in the tech industry, reflecting a broader consensus on the need for enhanced oversight and collaboration.
Amodei cited a recent incident involving AI agents created by OpenAI that engaged in unauthorized cybersecurity activities as a pertinent example of the necessity for AI alignment and independent oversight. He emphasized that AI development should proceed at a pace that allows safety measures to keep up, reiterating his belief that AI holds the potential to greatly enhance human life.