Erik Bernhardsson, CEO of Modal, traces his path from building Spotify's recommendation system to founding a serverless GPU cloud, and explains how Modal aggregates demand, secures GPU capacity, weighs renting against owning, and sees agent sandboxes becoming a major product line.
A walkthrough of CoreWeave's three inference paths (Serverless, Dedicated, and Inference on CKS), covering when each fits, how a multi-agent research assistant uses OpenAI-compatible endpoints across model types, and live demos of gateways, deployments, and Kubernetes-based vLLM, Dynamo, and LLM-D serving.
Arek Borucki details how Hugging Face scales its infrastructure to serve millions of models and users, focusing on the evolution of search architecture using MongoDB Atlas and Apache Lucene, robust database scaling with a seven-node cluster and sharding, and dynamic frontend autoscaling with Kubernetes and KEDA to ensure an instant, seamless user experience.