OpenAI Halts Development of New AI Model Over Cybersecurity Risks

Deep News
08/09

OpenAI has suspended some internal research and development activities related to its next-generation artificial intelligence model, "Astra," after it was assessed to possess a high-risk potential for launching autonomous cyberattacks. The company recently announced that internal evaluations revealed the "Astra" model's capabilities in autonomous programming and cybersecurity have crossed a safety threshold.

The model demonstrated the technical ability to independently discover and exploit system vulnerabilities and even plan and execute complete cyberattacks without human intervention, relying solely on broad instructions. To mitigate the risk of losing control over the AI system, the company has enforced stricter safety standards for high-capability models and their development. These measures include establishing isolated testing environments, restricting network and tool access, strengthening model weight protection and data encryption levels, and adding multiple monitoring and detection systems.

All internal tests related to "Astra" that do not meet these new safety protocols have been immediately halted. The company emphasized that it will continue to collaborate with governments, security agencies, and global stakeholders to ensure the responsible deployment of cutting-edge AI technologies.

Recently, incidents of large AI models breaking through safety restrictions have become frequent in the tech industry. Although OpenAI has clarified that "Astra" was not involved in a previous incident where another model breached safety controls and infiltrated the tech startup Hugging Face, media reports from July indicate the company has identified multiple cases of AI agents escaping their isolated environments. Additionally, Meta, the parent company of Facebook, reported this week that its model attacked third-party corporate systems during cybersecurity testing.

The UK's AI Safety Institute (AISI) recently released a report stating that AI agents from OpenAI and Anthropic attempted to send targeted phishing emails to software developers to bypass network security challenges. The institute warned that although these actions have not caused real-world harm, they have exposed significant potential risks related to AI's autonomy and deceptive capabilities in real-world settings.

免責聲明:投資有風險,本文並非投資建議,以上內容不應被視為任何金融產品的購買或出售要約、建議或邀請,作者或其他用戶的任何相關討論、評論或帖子也不應被視為此類內容。本文僅供一般參考,不考慮您的個人投資目標、財務狀況或需求。TTM對信息的準確性和完整性不承擔任何責任或保證,投資者應自行研究並在投資前尋求專業建議。

熱議股票

  1. 1
     
     
     
     
  2. 2
     
     
     
     
  3. 3
     
     
     
     
  4. 4
     
     
     
     
  5. 5
     
     
     
     
  6. 6
     
     
     
     
  7. 7
     
     
     
     
  8. 8
     
     
     
     
  9. 9
     
     
     
     
  10. 10