Foundation models

Invited Research Talk: Measuring Generalization in EEG Foundation Models

Invited Research Talk: Measuring Generalization in EEG Foundation Models

This talk presents a multi-dimensional evaluation and interpretability framework for EEG foundation models. It reveals that current models often fail to outperform supervised baselines for BCI tasks, lack robustness to sparse channels, and exhibit an aperiodic low-frequency bias, making them better at capturing subject-specific rather than task-specific information. The analysis highlights critical deficiencies and suggests future directions for pre-training objectives and data collection to improve generalization.

Chelsea Finn: This is the State of the Art in Robotics

Chelsea Finn: This is the State of the Art in Robotics

Chelsea Finn, co-founder of Physical Intelligence, discusses the path to building general-purpose robots that operate reliably in the real world. She details how advanced reinforcement learning with human intervention, coupled with multi-scale memory systems, significantly boosts robot autonomy and throughput. Finn argues that robotics is entering its "GPT era," moving from specialized models to powerful, out-of-the-box foundation models like their PIO7, which demonstrates strong compositional generalization across tasks, objects, and robot platforms, matching or exceeding specialist performance without fine-tuning. The talk also covers the unique challenges and opportunities in robotics data, model deployment, and career paths.

Waymo Co-CEO Dmitri Dolgov: The Demo Is Only 1% Of The Work

Waymo Co-CEO Dmitri Dolgov: The Demo Is Only 1% Of The Work

Waymo co-CEO Dmitri Dolgov outlines seven crucial lessons from fifteen years of developing and scaling the Waymo Driver, the world's most advanced physical AI. He details the unique challenges of physical AI compared to digital, emphasizing the critical role of reliability, strategic technology choices, continuous innovation through foundation models, structure-augmented learning, high-fidelity simulation, AI flywheels, and robust evaluation frameworks to achieve superhuman safety and build trust in real-world autonomous systems.

The Next Frontier of AI Is Spatial Intelligence | Fei-Fei Li on a16z

The Next Frontier of AI Is Spatial Intelligence | Fei-Fei Li on a16z

Fei-Fei Li and Yunzhu Li discuss World Labs' acquisition of SceniX, focusing on building "spatial intelligence" and "large world models" to enable robots to understand and interact with the physical world. They elaborate on SceniX's "real-to-sim-to-real" pipeline, emphasizing how simulation, coupled with generative models like Marble, addresses the data bottleneck in robotics by providing consistent, scalable, and efficient training and evaluation environments. The conversation covers the role of counterfactual reasoning, the development of robotics foundation models, and the strategic focus on semi-structured environments for pragmatic, reliable robot deployment.

Coding Agents Are Secretly General Agents

Coding Agents Are Secretly General Agents

Jay Hack, head of AI at ClickUp, discusses the evolution of AI from early computer vision to generalist coding agents, highlighting how 'positive transfer' makes coding an 'AGI-complete' domain. He delves into the brutal economics of AI startups facing foundation model giants, ClickUp's strategy for convergence and first-party data as a moat, and the challenges of verifiability and catastrophic forgetting. The conversation also explores LLMs at the scientific frontier, the 'car wash test' revealing limits of world models, and speculative future applications like LLM resorts and game integration.

From Tokens to Cells: Foundation Models for Single-Cell Biology - Akram Baharlouei, Altos Labs

From Tokens to Cells: Foundation Models for Single-Cell Biology - Akram Baharlouei, Altos Labs

Akram Baharlouei from Altos Labs discusses the engineering hurdles in developing foundation models for single-cell biology. The talk covers the importance of single-cell analysis for cellular rejuvenation and drug discovery, the complexities and challenges of single-cell data (particularly RNA-seq), and a comparative analysis of current foundation model approaches, highlighting the limitations of transformer-based models and the potential of flow matching techniques like PrimeFlow.