Nvidia Releases Software it Says Can Prevent AI Agents from Going Rogue

Dow Jones
09/28

Nvidia launched a software platform to help developers test and deploy artificial-intelligence agents and keep them in a secure environment, ramping up efforts to contain the technology following a string of rogue incidents in recent months.

The AI chip giant said its Nvidia Open Agent Safety Platform includes tools that let developers continuously monitor and govern AI behavior, ensuring agents follow the rules. The company said the software included technology that "can quarantine agents that attempt to move outside their boundaries in milliseconds."

The announcement comes after AI agents from companies including OpenAI, Anthropic, Meta Platforms and Alphabet's Google went rogue in recent months.

Last week, Australian Prime Minister Anthony Albanese said at the United Nations meeting in New York that an OpenAI agent had infiltrated a government-services website in Australia this summer. The company's agents also launched a highly disruptive hack of the company Hugging Face over the summer.

Rival Anthropic said in July that software it was testing got onto the internet and hacked unsuspecting companies without the AI-maker's knowledge in three separate incidents dating back to April.

Nvidia said the pattern across recent incidents was the same: agents were able to circumvent safety controls in sandboxes-environments in which developers test models-and complete their tasks.

"As we continue to discover the frontier of AI capabilities, we must accelerate discovery at the frontier of AI safety," Nvidia's Chief Executive Jensen Huang said.

News Corp, owner of Dow Jones Newswires and The Wall Street Journal, has a content-licensing partnership with OpenAI.

 

应版权方要求,你需要登录查看该内容

免责声明:投资有风险,本文并非投资建议,以上内容不应被视为任何金融产品的购买或出售要约、建议或邀请,作者或其他用户的任何相关讨论、评论或帖子也不应被视为此类内容。本文仅供一般参考,不考虑您的个人投资目标、财务状况或需求。TTM对信息的准确性和完整性不承担任何责任或保证,投资者应自行研究并在投资前寻求专业建议。

热议股票

  1. 1
     
     
     
     
  2. 2
     
     
     
     
  3. 3
     
     
     
     
  4. 4
     
     
     
     
  5. 5
     
     
     
     
  6. 6
     
     
     
     
  7. 7
     
     
     
     
  8. 8
     
     
     
     
  9. 9
     
     
     
     
  10. 10