Ai workloads

The 100,000 Sandbox Problem — Akshat Bubna, Modal CTO

The 100,000 Sandbox Problem — Akshat Bubna, Modal CTO

Modal CTO Akshat Bubna discusses the company's shift from developer to agent experience, highlighting why traditional cloud infrastructure fails for bursty AI workloads. He details Modal's primitives like elastic inference with GPU snapshotting and speculative decoding, agent sandboxes for RL rollouts, multi-node training with RDMA, and a "supercloud" strategy across 17 providers. The conversation also covers the importance of observability, hard guardrails for production agents, and AI's role in making infrastructure exciting again.

Building Data Centers for GPU Clouds

Building Data Centers for GPU Clouds

Craig Tavares, COO of Buzz HPC, provides an in-depth look at the complexities of building and scaling GPU cloud infrastructure for AI. He covers the critical role of renewable energy and strategic location, the evolution of data center design to handle extreme power densities, the importance of a strong partnership with NVIDIA, and the rise of sovereign mandates shaping the future of AI cloud services.