Robots Will Be Trained on Video Games - Pim de Witte, General Intuition

Pim de Witte of General Intuition argues that models acting in space and time should be built differently from turn-based LLMs. Their continuous frames-in, actions-out model is trained on Medal game recordings, since game controllers already drive most robots, and it can play games and control more than ten robot types. The talk covers world models, action density, applications such as accessibility and UX, the difference from JEPA, and upcoming early access and hackathons.