Anthropic Urges Global Pause in AI Development, Flags 'Self-Improvement' Risk -- WSJ

Dow Jones
06/05

By Bradley Olson and Sam Schechner

Anthropic is calling for top AI labs to weigh slowing the pace of development, suggesting that AI systems are advancing so rapidly that they may soon be able to improve themselves without human intervention in ways that could pose significant societal risks.

The ability to slow global AI development would "likely be a good thing, " the company said Thursday in a blog post that disclosed internal data documenting how quickly its most advanced models are improving.

The post, written by the head of its internal research institute and head of policy, noted that model advances appear to be on a path toward "recursive self-improvement," when AI systems can improve on their own without human intervention. Some AI insiders have seen that threshold as a potential marker of danger and enormous societal upheaval.

"We believe it would be good for the world to have the option to slow or temporarily pause frontier AI development to enable societal structures and alignment research to keep up with the advance of the technology," the post, written by Marina Favaro and Jack Clark, says. It proposes a global agreement on how to potentially slow development and a mechanism for verifying that competitors are respecting it.

The post cautions that recursive self-improvement hasn't yet happened and isn't inevitable, "but could come sooner than most institutions are prepared for."

Anthropic recently concluded a fundraising round that valued the company at almost $1 trillion and filed confidential paperwork to begin the process of publicly listing its shares. The company has recently emerged as the front-runner in a ferocious competition for AI supremacy with ChatGPT-maker OpenAI, which is also expected to file paperwork for an initial public offering soon.

Anthropic's run-rate, a figure commonly used by startups that forecasts annual revenue based on short-term sales, is on track to reach $50 billion in sales by the end of this month, up from $9 billion at the end of 2025.

Write to Bradley Olson at bradley.olson@wsj.com and Sam Schechner at Sam.Schechner@wsj.com

 

(END) Dow Jones Newswires

June 04, 2026 15:44 ET (19:44 GMT)

Copyright (c) 2026 Dow Jones & Company, Inc.

應版權方要求,你需要登入查看該內容

免責聲明:投資有風險,本文並非投資建議,以上內容不應被視為任何金融產品的購買或出售要約、建議或邀請,作者或其他用戶的任何相關討論、評論或帖子也不應被視為此類內容。本文僅供一般參考,不考慮您的個人投資目標、財務狀況或需求。TTM對信息的準確性和完整性不承擔任何責任或保證,投資者應自行研究並在投資前尋求專業建議。

熱議股票

  1. 1
     
     
     
     
  2. 2
     
     
     
     
  3. 3
     
     
     
     
  4. 4
     
     
     
     
  5. 5
     
     
     
     
  6. 6
     
     
     
     
  7. 7
     
     
     
     
  8. 8
     
     
     
     
  9. 9
     
     
     
     
  10. 10