World models

Attention, World Models and the Future of AI — with Prof. Kyunghyun Cho

Attention, World Models and the Future of AI — with Prof. Kyunghyun Cho

Professor Kyunghyun Cho, a co-author of the first paper on attention, discusses the future of AI. He argues that today’s models have already captured most correlations in passive data, making the real challenge about actively choosing which data to collect. He also explores the open debate around world models, the surprising lack of coding agent adoption among his students, and the foundational work that led to Retrieval-Augmented Generation (RAG).

This Technology Scares OpenAI (Here's Why)

This Technology Scares OpenAI (Here's Why)

Jeff Hawke, CTO at Odyssey, provides a deep dive into the emerging field of "world models"—AI systems that generate continuous, interactive simulations. He draws parallels to the "GPT-2 era" of LLMs, outlining the current state, core research challenges like coherence and control, and the immense potential for applications in gaming, robotics, and content creation. Hawke also clarifies the confusing terminology, distinguishing canonical world models from spatial intelligence and generative video models like Sora.

Introducing 4D Creation Open Beta and the Future of Gaming with Roblox CEO Dave Baszucki

Introducing 4D Creation Open Beta and the Future of Gaming with Roblox CEO Dave Baszucki

Roblox CEO Dave Baszucki discusses the company's 20-year vision to build the "Holodeck," a high-fidelity, 4D simulation for human co-experience. He explains how Roblox is leveraging its 13 billion monthly hours of vector data to train native AI models for advanced NPCs, moving beyond simple LLMs to create "virtual doppelgängers." Baszucki also covers the future of immersive communication, AI's role in transforming game creation, and Roblox's unique, data-driven approach to hiring talent.

"We Made a Dream Machine That Runs on Your Gaming PC"

"We Made a Dream Machine That Runs on Your Gaming PC"

Shahbuland Matiana and Andrew Lapp from Overworld Labs introduce Waypoint 1, a 2 billion-parameter open-source world simulation model designed to run on consumer hardware at 60 FPS. They discuss its novel architecture, which combines a causal language model with an image diffusion model to denoise frames in real-time based on user prompts and controller inputs, emphasizing low-latency interaction and the importance of local execution for user privacy.

Code World Model: Building World Models for Computation – Jacob Kahn, FAIR Meta

Code World Model: Building World Models for Computation – Jacob Kahn, FAIR Meta

Jacob Kahn from FAIR, Meta, introduces the Code World Model (CWM), a new paradigm for AI models that learn from program execution rather than just code syntax. By training on detailed execution traces, CWM builds an internal world model of computation, enabling it to predict a program's behavior. This talk explores CWM's architecture, its highly scalable and asynchronous reinforcement learning setup, and groundbreaking applications like a 'neural debugger' that understands user intent from code structure and the potential to approximate undecidable problems like the halting problem.

The future of intelligence | Demis Hassabis (Co-founder and CEO of DeepMind)

The future of intelligence | Demis Hassabis (Co-founder and CEO of DeepMind)

Google DeepMind CEO Demis Hassabis discusses the path to AGI, focusing on the scientific frontiers of the next decade. He covers the importance of solving 'root node' problems like fusion energy, the challenge of 'jagged intelligence' in current models, and the promise of world models and simulations like Genie and SimA. The conversation also explores the balance between scientific rigor and commercial competition, and the profound societal and philosophical questions AGI will force us to confront.