Monarch - Single-Machine DevX at Distributed Scale

PyTorch Conference North America 2026

Oct 20, 2026 · 11:10–11:35 · Timezone not confirmed

A developer’s computer is part of their identity; as unique as a fingerprint. People have their favorite tools, libraries, and agents set up for their own productivity (and happiness!). New projects that run locally are productive to work in. Unfortunately, as projects scale, we trade this development experience for more compute, using clusters with worse ergonomics. Monarch is a library for programming an entire cluster as if it were a single machine. Imperative APIs launch processes across the cluster that communicate with fast actor-based IPC and transfer data using RDMA. This fabric lets us provide services that make it feel like all processes across the cluster are on your local machine. For instance, we use Monarch to build filesystem mounts so the local filesystem is broadcast to the entire cluster, and remote logs appear locally. Iterating with Monarch takes seconds rather than minutes. Debugging is easier: the distributed process exits like a local process and its outputs are visible locally. This speeds up the development loop for humans and agents. This talk will demo the experience and show how to use Monarch primitives to build large scale post training frameworks.

Session status: scheduled

Room: LL20CD

Track: Training

Level: Intermediate

Official session / agenda

Saving a session is not registration. Check the official agenda for availability, eligibility and any additional fees.

Speakers and their event affiliations

Parent event

In person · San Jose Convention Center, San Jose, California, United States

This describes the parent event. Confirm the session’s attendance requirements with the organizer.

Companies participating in the parent event

These are event-level relationships, not confirmed sponsorship of this session.

Showing 24 of 130 company relationships. View all on the event page.