Cisco gives its Secure AI Factory with NVIDIA a secure multi-agent edge up

Why we constructed the Safe AI Manufacturing unit

One yr in the past at NVIDIA GTC, Cisco and NVIDIA launched the Cisco Safe AI Manufacturing unit with NVIDIA. On the time, the problem for enterprises was clear: AI was transferring from science challenge to strategic precedence, however the infrastructure and software program have been fragmented. Clients have been combating the complexity of standing up huge compute clusters for coaching, optimization, and inferencing, whereas making certain their information remained safe and personal.

To resolve this, the Safe AI Manufacturing unit was constructed upon the inspiration of Cisco AI PODs, our modular reference structure based mostly on Cisco Validated Designs and NVIDIA Enterprise Reference Structure–compliant deployments. By integrating Cisco networking, compute, and associate storage with NVIDIA’s accelerated infrastructure, the full-stack AI POD permits enterprises to seamlessly deploy AI functions with enterprise-grade safety fused into the material. Embedded into every layer of the reference structure and wrapped round it’s the Cisco portfolio of safety and observability capabilities options. It gives companies with a dependable, safe, hardened path to coaching, optimization, and inferencing inside the core information middle.

The rise of multi-agents all over the place

Within the final twelve months, the panorama of enterprise AI has shifted. We have now moved past easy generative AI chatbots and have now transitioned into the period of autonomous brokers that drive business-critical capabilities. The most important driver immediately is the necessity to run these multi-agent techniques all over the place: within the core, within the cloud, and more and more, on the edge.

Nevertheless, this shift has revealed an enormous hurdle: Safety is presently the one largest barrier to the enterprise adoption of AI brokers.

Not like a normal chatbot, an agent is autonomous; it has the ability to invoke APIs, entry information lakes, and make choices, thus enabling groups to lower time to worth. These brokers depend on massive language fashions (LLMs) and small language fashions (SLMs) to offer reasoning context. If the mannequin offering that context is attacked or goes down, the impression is catastrophic:

Compromised operational choice making: If an agent managing warehouse logistics is hijacked by means of immediate injection, it may very well be manipulated to authorize incorrect delivery priorities or “ghost” stock, resulting in vital margin erosion and unfulfilled buyer orders.
Vital workflow stagnation: In a high-velocity setting, if an edge mannequin goes down or its reasoning is corrupted, the automated course of stops. For a warehouse, this implies vehicles aren’t loaded and the provision chain grinds to a halt, immediately impacting the quarterly backside line.
Regulatory and compliance publicity: Brokers working on the edge usually deal with delicate information. A safety breach that results in the exfiltration of personally identifiable info (PII) or proprietary predictive fashions can lead to huge regulatory fines and a everlasting lack of buyer belief.

Extending Safe AI Manufacturing unit throughout the core to the sting

To fulfill these challenges, Cisco is asserting that it’s increasing Cisco Safe AI Manufacturing unit from the info middle to the sting, making certain safety follows the agent throughout your complete multi-agent spectrum.

With Cisco AI Protection, we offer a constant safety posture no matter location. Whether or not an agent is operating a trillion-parameter LLM within the information middle or a specialised SLM in a distant warehouse, Cisco ensures the mannequin is validated and the prompts are sanitized in actual time.

A brand new reference structure: Predicting stockouts for retail or manufacturing warehouses with Cisco Safe AI Manufacturing unit with NVIDIA and its ISV ecosystem

Whereas the Cisco AI POD gives a high-performance engine within the information middle, a brand new problem for some organizations lies on the warehouse flooring. At GTC, we’re showcasing how a warehousing workforce can leverage Cisco and associate structure to search out worth by means of visibility: understanding the precise second a stockout happens or a security hazard arises earlier than it impacts the morning shift. For IT, the problem is bridging the IT/OT hole by deploying and securing AI throughout a whole bunch of distant websites with out making a administration nightmare. Extending visibility and operations from the core information middle to the sting is about extra than simply {hardware}; it’s about getting the proper intelligence to the proper individual, securely and at scale.

At GTC, we’re demonstrating this growth by means of a real-world resolution extending the NVIDIA Multi-Agent Clever Warehouse blueprint. This demo showcases how specialised brokers can bridge the hole between IT and OT layers.

How the answer elements coordinate

The workflow begins on the edge, the place Vaidio acts because the “eyes” of the warehouse, monitoring video feeds for occasions like pallet stockouts. When a stockout or low inventory occasion is detected, Vaidio triggers a REST API name to an Aible agent operating domestically on Cisco Unified Edge. This agent makes use of an SLM to offer fast reasoning context—deciding if a stockout is crucial sufficient to disrupt a pending cargo. If motion is required, the sting agent pings a core agent within the Cisco AI POD hosted within the information middle, which queries the enterprise information lake and LLM to calculate the income impression.

For the warehouse supervisor, this closes the IT/OT hole totally. As an alternative of manually cross-referencing spreadsheets or discovering empty cabinets too late, the supervisor has a 24/7 digital assistant that identifies issues, calculates the enterprise value, and triggers an expedited order mechanically, eliminating “ghost stock” and preserving the provision chain transferring.

The answer structure

Vaidio (the eyes): Operating on Cisco Unified Edge nodes (3-4 nodes per website), Vaidio laptop imaginative and prescient containers make the most of NVIDIA L4 GPUs to watch the ground for stockouts or security hazards.
Aible (the mind): An agentic platform orchestrating the workflow throughout the sting and core. When Vaidio detects a problem by means of a RESTful API, an Aible agent on the edge makes use of a neighborhood SLM (comparable to Nemotron-3 Nano or Llama 3.3) to offer fast reasoning context.
Cisco AI POD (the core): For heavy-duty predictive modeling, edge brokers talk again to the core AI POD (powered by NVIDIA GPUs). This core long-running agent powered by Aible understands the right way to steadiness the impression of stockouts in opposition to the price of expedited delivery, queries the warehouse information lake to take the proper choices based mostly on income impression and invoke delivery APIs.
The deployment bundle: This resolution runs Kubernetes 1.34 on Ubuntu 24.04 LTS with NVIDIA Driver 580.95.05 throughout each edge nodes and core AI POD infrastructure.

Cisco Intersight gives centralized AI server fleet administration throughout core and edge, delivering infrastructure lifecycle management, coverage consistency, configuration governance, and operational visibility throughout distributed AI environments.

This ensures the underlying compute platform stays constant, safe, and scalable, whereas utility and container orchestration function inside a validated, enterprise-ready infrastructure basis.

Cisco AI Protection and complete safety for AI brokers and functions

There’s a brand new actuality within the enterprise: multi-agent techniques. And Cisco is the one vendor that embeds safety into the material of the AI Manufacturing unit, defending the whole lot from the infrastructure to the brokers that stay on it.

Cisco AI Protection gives a dual-layer protect from the info middle to the sting:

Mannequin integrity and scanning: AI Protection scans the LLMs and SLMs by means of their uncovered APIs/endpoints. This identifies potential vulnerabilities in mannequin information and identifies the “AI Invoice of Supplies” (AI-BOM) to make sure provide chain integrity.
Runtime guardrails: As brokers talk, AI Protection applies real-time insurance policies to sanitize prompts and responses. It detects immediate injections, prevents the technology of poisonous content material, and ensures that delicate information—together with PII, PHI, and PCI—by no means leaves the safe setting.
Platform safety: Cisco Unified Edge provides a bodily and firmware layer of safety, together with firmware roots of belief, locking bezels with intrusion detection, and Intel TDX/SGX for confidential computing.

The Aible distributed agent resolution highlighted above advantages from all three layers of safety. It runs securely on Cisco Unified Edge and Cisco AI POD servers. The fashions utilized by it on the core and the sting are scanned by AI Protection. All language mannequin interactions of the brokers on the core and edge use the runtime guardrails by default.

The way forward for multi-agents all over the place

The transfer to multi-agent AI represents the following industrial revolution of intelligence. By fixing the challenges of edge deployment and mannequin safety, Cisco helps clients transfer previous the experimental part and into real-world manufacturing.

By bringing the NVIDIA Multi-Agent Clever Warehouse blueprint to life on Cisco structure, we’re lastly delivering the “chocolate” to each side of the enterprise. The Warehouse Supervisor positive aspects a 24/7 digital coordinator by means of Vaidio and Aible that automates crucial workflows and eliminates “ghost stock.” Concurrently, the IT worker positive aspects a safe, “drift-free” platform managed with Cisco Intersight and guarded by AI Protection. This isn’t only a technical achievement; it’s a production-ready resolution that turns AI potential right into a aggressive benefit for your complete enterprise.

Keep tuned for our upcoming technical white paper, which can present a deep dive into the structure of the Safe Multi-Agent AI Manufacturing unit.

Able to speed up your time to worth? Contact your Cisco account consultant immediately to learn to prolong your safe AI technique from the core to the sting or click on right here to be taught extra concerning the Cisco Safe AI Manufacturing unit with NVIDIA.