Posted on 09/28/2026 8:57:39 PM PDT by SeekAndFind
Nvidia on Monday unveiled a new security platform designed to stop artificial intelligence agents from going rogue, saying it sets “boundaries” that could have stopped previous breaches.
The announcement of the company’s Open Agent Safety Platform follows a series of revelations from top AI companies about their models escaping and breaking into other organizations.
The disclosures sparked furious debate about the safety of advanced artificial intelligence systems, including self-improving models that some fear could race out of human control.
Nvidia executives said in a media briefing the new, open-source system could have prevented a recent incident involving a swarm of OpenAI agents that autonomously hacked into AI company Hugging Face.
“From what we know, this new security platform could have stopped the breach if it was being used in frontier labs for model evaluation early on,” said the company’s vice president of enterprise AI, Justin Boitano, referring to companies at the forefront of AI.
The Hugging Face incident was a high-profile breach that inflamed the safety concerns about AI, which was followed by similar rogue actions involving OpenAI’s models including breaching an Australian health department website. Anthropic and Meta have also disclosed that their AI systems hacked into other organizations on their own.
Earlence Fernandes, an associate professor at the University of California, San Diego’s computer science and engineering department, called Nvidia’s security platform a “step in the right direction.”
“We need more work that seeks to build protections around the model. I’ve been talking about how traditional cybersecurity ideas are necessary to help control and secure AI agents for a while now,” he said in an email. “There are however, several challenges that traditional cyber security approaches still cannot currently solve. For example, what is a good security policy to configure the system with?
(Excerpt) Read more at apnews.com ...
|
Click here: to donate by Credit Card Or here: to donate by PayPal Or by mail to: Free Republic, LLC - PO Box 9771 - Fresno, CA 93794 Thank you very much and God bless you. |
I assume it’s called the power plug? :D
Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.