Scaling AI Infrastructure Systems at Meta Scale

AGNTCon + MCPCon North America 2026

Oct 22, 2026 · 10:20–10:45 · America/Los_Angeles

Modern AI systems are no longer limited by models alone. They are increasingly constrained by infrastructure scalability, attribution pipelines, reliability, latency, and operational complexity. In this session, Neelakshi Soni shares lessons from building and scaling high throughput distributed systems at Meta and Amazon that process millions of requests per second. The talk covers real world engineering challenges in AI driven infrastructure, including attribution systems, config driven platform architectures, experimentation frameworks, performance optimization, and reliability engineering. Attendees will learn practical approaches for designing scalable backend systems, reducing operational overhead, improving developer velocity, and building production ready AI platforms that operate reliably at massive scale. This session is intended for backend engineers, infrastructure engineers, AI platform teams, and software engineers building production AI systems.

Session status: scheduled

Room: 210 BF

Track: Agentic Engineering

Level: Intermediate

Official session / agenda

Saving a session is not registration. Check the official agenda for availability, eligibility and any additional fees.

Speakers and their event affiliations

Parent event

In person · San Jose McEnery Convention Center, San Jose, California, United States

This describes the parent event. Confirm the session’s attendance requirements with the organizer.

Companies participating in the parent event

These are event-level relationships, not confirmed sponsorship of this session.

Showing 24 of 512 company relationships. View all on the event page.