Continuous flow models map naturally to a Schrödinger equation, the fundamental equation of quantum mechanics. This discovery proves that a trained generative model can be efficiently simulated on a future quantum computer, enabling a new, more powerful type of access to its learned distribution for tasks like Monte Carlo estimation and structure discovery.
This talk explores the paradox of why diffusion models generalize rather than memorize. It introduces an analytically tractable, wavelet-based parameterization of the score function, allowing for an interpretable analysis of how architectural biases (like locality) and data statistics interact to influence denoising performance and generalization.
An in-depth look at Gemma 4's novel transformer architecture with per-layer embeddings, enabling efficient parameter offloading for on-device inference. The discussion also covers its native multimodality, the state of fine-tuning, text-based diffusion models, and the growing intersection of research and engineering.
Predictive AI forecasts what will happen next based on historical data, while Generative AI creates new content by asking what something could look like. This summary explores their fundamental differences in outputs, data types, underlying models like transformers and diffusion systems, and how they can be used together in enterprise applications.
Sander Dieleman from Google DeepMind provides a behind-the-scenes look at the key components of training large-scale diffusion models for audio-visual data. The talk covers the entire pipeline, from the critical role of data curation and latent representations to the mechanics of diffusion, network architectures, sampling with guidance, and advanced control signals.
Moonlake AI presents a distinctive approach to world modeling, prioritizing interactive, action-conditioned environments built on symbolic representations and game engines over purely pixel-based generative models. This method focuses on causal reasoning, long-term consistency, and programmable rendering (via their 'Reverie' diffusion model) to create dynamic, multiplayer worlds, positioning itself as a platform for training embodied AI and revolutionizing game development.