A talk from Walden on deployment-first physical AI: getting general-purpose robots into real manufacturing production, using remote assistance as a human-in-the-loop safety and learning mechanism, and building a data flywheel in which operational data drives continuous improvement of large behavior models.
Anastasis Germanidis, co-founder of Runway, discusses the company's journey from early generative creative tools to frontier video models, emphasizing their pivot towards general-purpose world simulation. He details the evolution of Gen-1, Gen-2, and Gen-3 (scaling 10x after Sora's release), highlighting the importance of controllability and the inevitability of real-time generation. The conversation delves into cutting-edge applications like Interface World Models (a fully neural operating system) and World Models for Robotics, where third-person video data and robust simulation are key to training intelligent agents.
Christopher Manning, Stanford professor and now at Moonlake AI, traces AI history from Dartmouth in 1956 and Shakey the robot through the rise of large language models. He then argues for embodied intelligence built on action-conditioned simulation, and shows how Moonlake turns a photo into a manipulable, code-based world that can close the sim-to-real gap.
This Paper Club delves into the current state of robotics, addressing roadblocks like the sim-to-real gap and embodiment drift. Speakers present advancements in multi-scale memory for long-horizon tasks, self-supervised embodied reasoning, zero-shot dexterous manipulation via massive simulation, and the economic imperative of teleoperation-first robotics companies, concluding with optimizations for efficient, real-time World Action Models.