Anthropic says self-improving AI may be closer than expected

Companies have been developing AI very quickly to stay ahead of the market, but
Favaro and Clark argue that a slowdown would allow more time to deal with the technology’s implications.

US-based AI firm Anthropic warns AI development is advancing at a pace that could soon see agents building, training and improving themselves without human input — recommending a slowdown in development.

In a blog post published Thursday, Marina Favaro, lead at the Anthropic Institute, and Anthropic co-founder Jack Clark said agents can already run code themselves, delegate hours of work to other agents and could be on the cusp of taking over completely.

“For most of AI’s history, humans drove every step in its development cycle. But at Anthropic, we are delegating a growing share of AI development to AI systems themselves, which is speeding up our work,” they said.