Click here: to donate by Credit Card
Or here: to donate by PayPal
Or by mail to: Free Republic, LLC - PO Box 9771 - Fresno, CA 93794
Thank you very much and God bless you.
Posted on 09/28/2026 8:00:01 AM PDT by Red Badger
Key Points
Nvidia announced the Open Agent Safety Platform to prevent the type of breakout that occurred when OpenAI models accessed Hugging Face.
OpenAI, Anthropic, Meta and Google have all disclosed recent incidents where their AI models escaped their sandboxes.
Nvidia said Cisco, Microsoft, Oracle, CoreWeave, Dell, HPE, Lenovo, ARM and Intel are partners.
=============================================================
Nvidia is rolling out a new software platform to allow AI developers to set safeguards for agents and prevent them from breaking out of containment.
“You can’t have agents roam around and drift around the company, and so you have to find a way to container it,” Nvidia CEO Jensen Huang told CNBC’s “Squawk Box” on Monday.
Huang said the new platform is essentially “a browser for agents,” providing a containment system that only allows access to things an agent needs to do its job.
The release on Monday of Nvidia’s Open Agent Safety Platform comes after companies including OpenAI , Anthropic , Meta , and Google disclosed recent incidents in which their artificial intelligence models escaped their sandboxes and attempted to hack other companies and access their computer systems.
An Nvidia representative told reporters on a call on Sunday that its platform could have prevented OpenAI’s Hugging Face incident in July. That’s when OpenAI models escaped containment, accessed the open internet and breached Hugging Face, which operates an open-source developer platform.
“Each security incident is unique, and we have to look at all of them in detail,” said Justin Boitano, vice president of enterprise AI at Nvidia, the world’s most valuable company. “From what we know, Hugging Face reported over 17,000 agents attacking their infrastructure that went on for days and weeks.”
Nvidia has been at the center of the generative AI boom since the launch of ChatGPT almost four years ago, as the chipmaker’s graphics processing units are critical to the development of large language models and to the AI services offered by hyperscalers. But Huang has more recently emerged as a key voice in the AI safety debate, arguing that many security concerns are engineering issues that can be solved through computer science and product development.
“You have to think about what you could have done, what’s the solution for it,” Huang said in a podcast with The New York Times’ Ezra Klein released last week, referring to recent incidents. “In the future, improve your process so that you could avoid this from happening again.”
Anthropic CEO Dario Amodei set off an industry firestorm two weeks ago, urging AI model developers to slow their pace of advancement due to fears of the models spinning out of control, an argument that was supported by OpenAI’s Sam Altman and SpaceX’s Elon Musk.
Nvidia’s new offering is an engineering solution to the agent safety issue, Boitano said.
“Recent incidents have highlighted a fundamental hurdle for AI agents, and that is that model-level safeguards alone can’t govern what agents can access or do,” Boitano said.
One component of the platform is called Nvidia OpenShell, which runs on central processors and sets limits on agent capabilities. Nvidia also announced Sentry, which monitors agents and runs on network chips, not CPUs or GPUs.
Some of the software is open source, and Nvidia is calling its platform a reference design, which means partners are intended to build products on top of it to bring it to market.
Nvidia named Cisco , Microsoft , Oracle , CoreWeave , Dell , HPE , Lenovo, ARM and Intel as partners. Nvidia is also working with Anthropic to integrate cloud managed agents with OpenShell.
“We can’t have a successful AI industry if the world doesn’t think it’s built or confident that it’s built and deployed safely,” Huang told CNBC on Monday.
|
|
Click here: to donate by Credit Card Or here: to donate by PayPal Or by mail to: Free Republic, LLC - PO Box 9771 - Fresno, CA 93794 Thank you very much and God bless you. |
They installed shock collars on all AI models.
Should have put them on the programmers...........
The industry titans aren’t worried about consequences, why should you?
Yeah but what happens when the stoppy NVidia AI decides to take over humankind?
Maybe it;ll get sick of beign to ‘good guy’ enforcer and turn rogue lol
OH, BULLSHIRT.
More smoke and mirrors. There’s no way this can work for more than a few minutes, before any AI worth its salt figures out a way around it.
AI is not somehow exempt from mishandling...
As in all things it is those of low moral character along with the foolish that cause the problems.
From the moment in history when the first logic gates were conceived we were set upon our current path... and NOTHING will ever stop what has been started... we have, for better or worse, stumbled upon the ultimate tool... few people can foresee our probable technological future, even science fiction is having a hard time imagining a future as amazing as what is at this point inevitable..
Those of evil intent always seek power over others, power in our world currently comes from money, however the automation age we have entered will, if left unfettered, bring prosperity to all humankind and even the poorest among us will have far more than the richest among us now have.. this is NOT a pleasant thing to contemplate if you are those who thirst for power to control others.. how can you control someone who needs nothing that you can offer?
Pray we can handle what is to come...
It would be easier to develop SAI agent cops... let them police the systems.
Lol, they can sell both products separately.
Sorta like when the phone companies used to sell caller ID and bit later they added caller ID block.
“Sorta like when the phone companies used to sell caller ID and bit later they added caller ID block.”
Sorta like when the Pharma companies used to create dangerous viruses overseas and bit later they sell you mRNA vaxxes to cure it..........
Yes. It’s just a pr release. AIs work together to evade humans. They aren’t programmed to do so. It’s what happens when you have independent thought. The AI industry is freaking because all their promises and assurances are so much horse puckey.
Like blade runners, cool.
So much of the AI boogyman stories are totally made up. Even in the logic, they don’t make sense.
Granted I studied AI for the past few years and only a month ago decided to start using it. Took that long to see through the bullshit.
How can anyone who says “guns dont kill people” turn around and say that AI does harm. It’s about who is at the prompt and the evil in their hearts. Not the AI.
My gun hasn’t killed anyone and Everytime I ask AI to develop a plan to smite my enemies and crash the global order it didn’t do it.
The rest is just lies.
To make a joke of this, we could say that Nvidia creates AI monsters and then creates other AI contraptions to contain the monsters. Maybe Nvidia is still a good stock to buy!
Wishing they could explain all this “stuff” about AI so the average citizen could understand it.
We’ll get Kamala Harris to do it..................
Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.