AI Builders Global Conference 2026
Oct 14, 2026 – Oct 16, 2026 · Virtual · scheduled
At this event: Google
Lalitha Madhurima Gayathri Kolluru
Cloud AI Infrastructure engineer
As Large Language Models (LLMs) scale exponentially, the infrastructure required to serve them faces a critical efficiency wall. This session explores how Python serves as the primary control plane for massive AI workloads, demonstrating how a single parameter change in a Python line can optimize underlying serving frameworks like vLLM. We will illustrate how high-level Python code orchestrates complex techniques—such as PagedAttention, quantization, and chunked prefill—translating a simple flag into massive compute and memory savings across thousands of cluster machines, ultimately slashing latency and operational costs.
Event connections
Showing 1 of 1 published event connections.
Sources & verification
Showing 2 of 2 published source records.
A source check is not a claim of complete extraction.