Onpode
Cover art for Nvidia released OpenShell—a hardware-software stack letting Anthropic, OpenAI, and others run bounded AI agents

Nvidia released OpenShell—a hardware-software stack letting Anthropic, OpenAI, and others run bounded AI agents

October 21, 2026 · 9 min

Iris Holm & Cyrus Reed

Nvidia announced OpenShell on October 21 at GTC Berlin — a hardware-software stack for containing AI agents inside fixed operational limits. The catch: Nvidia's own NeMo Agent Toolkit had been silently bypassing its own tool-call limits for eighteen months, undetected, while OpenShell was being built to prevent exactly that.

On Wednesday, October 21, 2026, Nvidia unveiled the OpenShell Reference Architecture at GTC Berlin. The announcement was made by CEO Jensen Huang and positions OpenShell as a full-stack, industrial-scale design for building, containing, observing, and enforcing safety policies for AI agents deployed across enterprise data centers and edge infrastructure.

0:009:25
Get the next episode on Technology →

Follow it free — new episodes land in your feed.

Or make your own — any topic, in minutes

More Onpode episodes on Technology →

About this episode

At GTC Berlin on October 21st, Nvidia announced OpenShell — a full-stack architecture designed to keep AI agents inside fixed operational limits using out-of-band monitoring on BlueField DPUs. The pitch was foundational: a hardware-rooted containment layer that Anthropic, OpenAI, Meta, Google, AWS, and dozens of others have signed onto. The episode asks what that pitch is actually worth. The sharpest tension: Nvidia's own NeMo Agent Toolkit had been silently bypassing its own tool-call limits for eighteen months before anyone noticed. That's the failure mode OpenShell is supposed to make impossible. Huang said nothing about it on stage. The episode works through the actual architecture — why separating the monitoring layer onto different silicon is a meaningful security bet, and why it only works if you stay on Nvidia hardware. The software is open-source. The enforcement is not portable. That gap is the CUDA playbook running again: define the standard, own the dependency underneath. It also unpacks the partner list (Cisco's engineering blog versus Okta's press-release checkbox), a quiet date conflict that creates real certification confusion for procurement teams, and what the Einride autonomous-truck announcement was actually doing at the same event. The risk that doesn't get named isn't a dramatic agent breakout. It's a Thursday afternoon vendor review where someone certifies against the wrong version.

Frequently asked

What is Nvidia OpenShell?

Nvidia OpenShell, announced October 21 at GTC Berlin, is a hardware-software reference architecture for running AI agents inside fixed operational boundaries. It uses BlueField DPUs running Nvidia Sentry as an out-of-band monitoring layer, separate from the agent process itself, so containment persists even if the agent is fully compromised.

Does Nvidia OpenShell require Nvidia hardware to work?

Yes. OpenShell's software layer is open-source, but its enforcement layer — Nvidia Sentry — runs on BlueField DPUs and requires Nvidia's Vera CPU and Vera Rubin silicon underneath. Without that hardware substrate, Sentry cannot execute. Supported environments including AWS, Google Cloud, and Azure all require the Nvidia hardware stack.

What was the NeMo Agent Toolkit security flaw?

Nvidia's NeMo Agent Toolkit, its own agent framework, was silently bypassing its own tool-call limits for eighteen months before being caught. The flaw went undetected because software was monitoring software — the exact failure mode OpenShell's out-of-band hardware enforcement is designed to prevent.

Which companies are partnering with Nvidia on OpenShell?

Nvidia listed Anthropic, OpenAI, Meta, Google Cloud, AWS, Microsoft, Cohere, Perplexity, and SpaceX Super Intelligence as collaborators, plus Canonical, SUSE, Red Hat, Cisco, Okta, Zscaler, 1Password, and BBVA. Cisco published a dedicated engineering blog on OpenShell integration; most others issued compatibility statements or press-release quotes.

Is Nvidia OpenShell doing to AI agents what CUDA did to GPU computing?

That is the structural parallel analysts are drawing. OpenShell's software is open-source, but enforcement requires Nvidia BlueField DPUs — the same pattern as CUDA, where an open standard masks a proprietary hardware dependency. Whoever defines the hardware-software boundary for AI agent containment first is positioned to own that standard across enterprise infrastructure.

Grounded in 8 sources
Nvidia debuts platform for keeping AI agents from going rogue and humanoid robot design at GTC Berlin - Yahoo Finance ↗ · finance.yahoo.com
Nvidia OpenShell gets a hardware stack for Anthropic and OpenAI agents - The Next Web ↗ · thenextweb.com
Securing AI Agents Across the AI Factory - Cisco Blogs ↗ · blogs.cisco.com
How NVIDIA OpenShell Reference Architecture Secures and Governs AI Agent Workloads at Scale | NVIDIA Technical Blog ↗ · developer.nvidia.com
Einride expands Nvidia partnership to deploy AI reasoning model for self-driving trucks - marketscreener.com ↗ · marketscreener.com
NVIDIA Launches OpenShell Reference Architecture for Safe AI Agents | NVIDIA Newsroom ↗ · nvidianews.nvidia.com
NVIDIA Launches OpenShell to Secure Enterprise AI Agents | The Tech Buzz ↗ · techbuzz.ai
Nvidia CEO Jensen Huang says AI will create more programmers, not replace them - Ynetnews ↗ · ynetnews.com
Read transcript

Cyrus Reed: Iris, hey — did you catch any of GTC Berlin this week or was it all slides for you?

Iris Holm: Slides. All slides. But one thing stuck.

Cyrus Reed: The NeMo thing.

Iris Holm: The NeMo thing.

Cyrus Reed: Wait, no, let me back up — because the NeMo thing only lands if you see it against what Jensen Huang was actually doing on stage. So: Wednesday, October 21st, GTC Berlin. Jensen's up there, the whole production, and he's announcing OpenShell — Nvidia's full-stack architecture for running AI agents inside fixed operational boundaries. And the framing is big, like, billions of agents framing, Anthropic, OpenAI, Meta, Microsoft, Google Cloud, AWS all named as collaborators, and he's pitching this as — I mean the phrase being used is basically 'we figured out how to contain AI agents at the hardware level.' That's the story he's telling.

Iris Holm: Right. And the NeMo bypass is what exactly?

Cyrus Reed: Nvidia's own NeMo Agent Toolkit — their agent framework — had been bypassing its own tool-call limits. Silently. Undetected. For eighteen months. Nobody caught it, nobody fixed it — it just sat there while Nvidia was building the thing that's supposed to make that impossible.

Iris Holm: Wait — how long?

Cyrus Reed: Eighteen months. And that's not eighteen months at some startup — that's eighteen months inside the toolkit Nvidia built to enforce agent limits. So when Huang gets on stage at GTC Berlin and says 'we've solved this at the hardware level,' the thing that's supposed to need solving was quietly broken at his own company the whole time.

Iris Holm: And he said nothing about it.

Cyrus Reed: Not a word. No acknowledgment. Which — okay, I get why, but it makes the pivot to 'trust the hardware' harder to just accept without asking the next question.

Iris Holm: What is the hardware claim, actually? Strip the branding.

Cyrus Reed: So — okay, the core idea is this: the monitoring doesn't run inside the agent process. It runs on BlueField DPUs, separate silicon, executing something called Nvidia Sentry. Out-of-band. Completely outside the process the agent is actually running in.

Iris Holm: Like a building's fire suppression system on its own power circuit. Main power goes out, the sprinklers still fire — because they're not on the same wires the building can cut.

Cyrus Reed: That's — wait, that's exactly it. The suppression system isn't inside the building it's protecting. The agent can go rogue, it can try to exceed its limits, and the circuit watching it is somewhere the agent literally cannot reach.

Iris Holm: Right. Which is why the NeMo failure is so pointed — that was software watching software. Same wires. Of course it got cut.

Cyrus Reed: And the BlueField DPUs running Sentry are — I mean they're separate from Vera CPUs, separate from the main compute, so even if the agent process is fully compromised, the monitoring layer just... keeps running. That's the actual architectural bet Nvidia is making here.

Iris Holm: But that only works if you're on Nvidia silicon. BlueField DPUs, Vera CPUs, Vera Rubin underneath. Strip any one of those out and Sentry has nothing to run on.

Cyrus Reed: Right, and — okay, that's the actual thing I want to pull on because — so the software layer is open-source. Genuinely. You can read it, fork it, whatever. But the enforcement layer? Cannot execute without Nvidia hardware underneath. Canonical, SUSE, Red Hat, Microsoft's Execution Containers, AWS, Google Cloud, Azure — they're all listed as supported environments, which sounds like 'runs everywhere,' but every single one of those requires the Nvidia hardware substrate. Without BlueField DPUs, Sentry is just... a document.

Iris Holm: Openness with a gate.

Cyrus Reed: Which — wait, CUDA keeps striking me as the key. Like, that playbook. Open standard, proprietary dependency underneath, and suddenly you're not picking Nvidia, you're just picking the standard. That's how it captures an ecosystem without looking like capture.

Iris Holm: And the Einride announcement — that's not coincidence, is it.

Cyrus Reed: No — and honestly this is the part nobody is connecting. Einride, autonomous trucks, AI reasoning models for self-driving logistics — that partnership dropped at GTC Berlin the same day as OpenShell. Real agents. Real cost limits that actually matter, because a truck rerouting itself outside its cost envelope isn't an abstract failure, it's a liability event on a highway. And what's underneath that? Nvidia silicon. So that's not a side announcement — that's the proof-of-concept. That's Nvidia showing the hardware-rooted containment story with operational stakes attached.

Iris Holm: Hm. Demo you didn't know was a demo.

Cyrus Reed: And it makes the CUDA parallel actually sharper — because USB, x86, Android — every one of those was won by whoever defined the hardware-software boundary first. Nvidia is doing that move right now with OpenShell. Everyone signs on because not signing on means you're outside the standard. That's not consensus, that's just — I mean, it's gravity.

Iris Holm: Which is exactly why the partner list needs unpacking — and that's where the March 2026 date conflict gets uncomfortable. We'll get there.

Cyrus Reed: But the partner list is where the gravity metaphor actually breaks down — because not everyone in orbit is pulling the same weight. Like, Anthropic and OpenAI are listed as agent providers. Meta. Google, Cohere, Perplexity, SpaceX Super Intelligence. That sounds like a coalition. But then you scroll down and Okta is listed as 'adding support.' Zscaler. 1Password. And — wait, what does 'adding support' even mean? Is that co-design or is that a press-release checkbox?

Iris Holm: Cisco is the tell.

Cyrus Reed: How so?

Iris Holm: Cisco published an actual engineering blog. Not a quote in a press release — a dedicated post on securing AI agents across the AI factory using OpenShell. That's engineering hours. That's someone at Cisco who read the spec and wrote something technical about it. Okta issued a compatibility statement. Those are not the same artifact.

Cyrus Reed: So Cisco is — okay, that's one concrete data point versus a list of twenty-something names that are basically just... present.

Iris Holm: And then SpaceX Super Intelligence. Look at the categories — it's in the agent providers column AND the broader collaborators column. Same company, both lists. That's either someone copy-pasting a spreadsheet or — frankly — it's a signal that SpaceX Super Intelligence is hedging. They want credit for building on OpenShell and credit for helping design it.

Cyrus Reed: No way — wait, actually both? That's — I mean, that's a strange place to be in a coalition document.

Iris Holm: Now here's the date problem. MarkTechPost has a source dated March 2026 — OpenShell already open-sourced, already out. GTC Berlin is October 21st. So picture a procurement engineer somewhere, not Tuesday morning, let's say she's doing a vendor review on a Thursday afternoon — she's got a shipment-routing agent that has hard cost-limit constraints, and she's trying to figure out which version of OpenShell she's actually certifying against. The March software release? Or the October bundle that adds BlueField DPUs and Sentry underneath? Because those are different things with the same name.

Cyrus Reed: And if she certifies against the March build — the hardware enforcement layer isn't even in scope. She's back to software watching software. Which is exactly the failure mode OpenShell was supposed to retire.

Iris Holm: And that's the failure mode that doesn't get named. It's not a dramatic breakout. It's a procurement decision on a Thursday.

Cyrus Reed: Yeah — and I mean, that's where Jensen Huang's 'billions of agents' framing gets actually kind of heavy when you sit with it, because — wait, he's not pitching a safety product. He's pitching foundational infrastructure. Billions of agents means OpenShell, if it sticks, is the enforcement layer for AI agents across enterprise data centers, edge infrastructure, globally. That's not a niche tool. That's — I mean that's the entire operational envelope for how agents run. Nvidia owns that boundary. And it succeeds not because everyone agreed it was the safest option, but because the first time an agent escapes containment and causes a real incident, whatever held will be the thing people point to. And whatever held will be running on BlueField DPUs.

Iris Holm: And if it fails — it fails the same way NeMo did. Quietly. Eighteen months before anyone notices.

Cyrus Reed: And then the next architecture comes out and promises exactly this.

Iris Holm: And Nvidia will still have sold the hardware.