Compute, Latency, and Safety: Architecting Stateful Guardrails for Multi-Agent Workflows

PyTorch Conference North America 2026

Oct 20, 2026 · 11:45–11:55 · Timezone not confirmed

Deploying a single LLM is a solved infrastructure problem. Deploying a multi-agent system where autonomous nodes pass state, execute external tools, and orchestrate complex workflows introduces a massive architectural bottleneck: How do you secure inter-agent handoffs without destroying real-time throughput? In production environments serving millions of users, standard security checks fail to catch "indirect orchestration exploits" (where untrusted data corrupts downstream agent privileges). But evaluating every single state change with a massive frontier model is computationally impossible and financially ruinous. This session breaks down the MLOps infrastructure required to secure multi-agent architectures at enterprise scale. Drawing from the development of open-source evaluation frameworks like SecRepoBench, we will detail how to build continuous, stateful red-teaming pipelines. Attendees will learn how to deploy specialized, low-latency Small Language Models (SLMs) as deterministic orchestration guardrails, routing cross-agent payloads through high-speed evaluation checks that catch prompt injection and operational drift without bottlenecking the entire system.

Session status: scheduled

Room: LL21ABC

Track: Responsible AI

Level: Advanced

Official session / agenda

Saving a session is not registration. Check the official agenda for availability, eligibility and any additional fees.

Speakers and their event affiliations

Parent event

In person · San Jose Convention Center, San Jose, California, United States

This describes the parent event. Confirm the session’s attendance requirements with the organizer.

Companies participating in the parent event

These are event-level relationships, not confirmed sponsorship of this session.

Showing 24 of 130 company relationships. View all on the event page.