Why a new report on Anthropic automating AI development is alarming researchers

A new report by METR found that Anthropic's AI models are improving at a rate twice as fast as they were a year ago, with benchmark scores suggesting two years of progress in just one year. This rapid acceleration raises concerns about the pace and risks of frontier AI development, despite Anthropic's CEO calling for slowing down AI development. The report is based on an 11-week investigation inside the company and highlights the need for transparency and oversight in AI research. Anthropic was allowed to redact parts of the report, raising questions about the extent of public knowledge about the company's AI development. The report's findings come at a pivotal time for Anthropic, as the company prepares to go public.