Nvidia unveils platform to prevent AI agents from going rogue

OpenShell is an open-source secure runtime that gives AI agents clear, enforceable boundaries, according to the CEO.

“It traces their actions and enforces policy as they work,” Huang added.

NVIDIA Sentry adds an out-of-band watchdog to continuously monitor agent behaviour, and can quarantine agents that attempt to move outside their boundaries in milliseconds.

“Organisations can deploy elements of NVIDIA Open Agent Safety Platform according to their unique requirements,” the chipmaker said in the announcement.

According to the firm, industry leaders across the AI ecosystem are joining Nvidia to strengthen AI safety for every industry. They include Anthropic, Cisco, CrowdStrike, Dell Technologies, Figure, HPE, Hugging Face, JPMorganChase, Microsoft, Palantir, Palo Alto Networks, Perplexity, Red Hat, Salesforce, SAP, Scale AI, ServiceNow and SpaceXAI.