Anthropic urges the world to halt further AI development

Jun 06 (Jowhar) - Anthropic is urging the world to stop the most powerful artificial intelligence systems, arguing that today's frontier models are beginning to show warning signs that they could surpass human control.

The company, based in San Francisco and well-known for the Claude family of AI models, stated in a report that a global coordinated slowdown in modern advancements "is likely to be a good thing." However, it warned that a unilateral pause would be ineffective, as competitors would simply continue.

“I believe it would be better for the world to have the option to slow down or temporarily pause the development of frontier AI to allow societal frameworks and coordinated research to keep pace with technological advancements,” it said.

For any pause to make sense, Anthropic stated, major AI developers in many countries - particularly the United States and China - would need to simultaneously halt under reliable and verifiable regulations.

“Without a global coordination mechanism, companies and governments will have to make tough decisions about safety while under competitive and geopolitical pressure,” it said.

Anthropic's position has faced criticism from parts of the AI industry and some officials in the White House, who argue that the company is overly reliant on worst-case scenarios - warning that their message could backfire in attempts to reduce competition while carrying a safety banner.