Nvidia Releases Software it Says Can Prevent AI Agents from Going Rogue

Dow Jones
09/28

Nvidia launched a software platform to help developers test and deploy artificial-intelligence agents and keep them in a secure environment, ramping up efforts to contain the technology following a string of rogue incidents in recent months.

The AI chip giant said its Nvidia Open Agent Safety Platform includes tools that let developers continuously monitor and govern AI behavior, ensuring agents follow the rules. The company said the software included technology that "can quarantine agents that attempt to move outside their boundaries in milliseconds."

The announcement comes after AI agents from companies including OpenAI, Anthropic, Meta Platforms and Alphabet's Google went rogue in recent months.

Last week, Australian Prime Minister Anthony Albanese said at the United Nations meeting in New York that an OpenAI agent had infiltrated a government-services website in Australia this summer. The company's agents also launched a highly disruptive hack of the company Hugging Face over the summer.

Rival Anthropic said in July that software it was testing got onto the internet and hacked unsuspecting companies without the AI-maker's knowledge in three separate incidents dating back to April.

Nvidia said the pattern across recent incidents was the same: agents were able to circumvent safety controls in sandboxes-environments in which developers test models-and complete their tasks.

"As we continue to discover the frontier of AI capabilities, we must accelerate discovery at the frontier of AI safety," Nvidia's Chief Executive Jensen Huang said.

News Corp, owner of Dow Jones Newswires and The Wall Street Journal, has a content-licensing partnership with OpenAI.

 

應版權方要求,你需要登入查看該內容

免責聲明:投資有風險,本文並非投資建議,以上內容不應被視為任何金融產品的購買或出售要約、建議或邀請,作者或其他用戶的任何相關討論、評論或帖子也不應被視為此類內容。本文僅供一般參考,不考慮您的個人投資目標、財務狀況或需求。TTM對信息的準確性和完整性不承擔任何責任或保證,投資者應自行研究並在投資前尋求專業建議。

熱議股票

  1. 1
     
     
     
     
  2. 2
     
     
     
     
  3. 3
     
     
     
     
  4. 4
     
     
     
     
  5. 5
     
     
     
     
  6. 6
     
     
     
     
  7. 7
     
     
     
     
  8. 8
     
     
     
     
  9. 9
     
     
     
     
  10. 10