Neural networks

The mathematics of AI uncertainty

The mathematics of AI uncertainty

Zoubin Ghahramani, a leading researcher at Google DeepMind and professor at Cambridge, argues that incorporating uncertainty is a missing piece for ever-improving AI. He discusses the critical difference between correctness and confidence in AI, tracing the historical evolution of probabilistic models from early neural networks to modern Bayesian approaches. Ghahramani highlights how current large language models often 'fake' uncertainty and explores successful implementations in areas like weather forecasting and AlphaFold, ultimately advocating for architectural innovations over pure scale to build more robust, trustworthy, and human-aligned intelligent systems that understand their own limitations.

Understanding the inner thoughts of AI

Understanding the inner thoughts of AI

Neel Nanda, head of Google DeepMind's language model interpretability team, discusses the critical field of interpretability, likening it to the "neuroscience of AI." He explains why understanding the internal workings of "grown, not designed" neural networks is crucial for AI safety and scientific discovery. The episode explores cutting-edge techniques like Chain of Thought monitoring, mechanistic interpretability (steering and probing), and Sparse Autoencoders, highlighting their strengths and limitations in debugging, detecting deception, and uncovering hidden model objectives. Nanda emphasizes interpretability's role in building safe, aligned, and trustworthy AI as we approach AGI, acknowledging its pragmatic necessity despite inherent limits to full understanding.

Rivian’s Roadmap to AI Architecture and Autonomy with Founder and CEO RJ Scaringe

Rivian’s Roadmap to AI Architecture and Autonomy with Founder and CEO RJ Scaringe

Rivian CEO RJ Scaringe discusses the company's complete pivot from a rules-based '1.0' autonomy system to a vertically integrated, neural network-based architecture. He outlines the essential ingredients for success in autonomous driving—from custom inference chips to a robust data flywheel—and explains why a software-defined vehicle architecture is non-negotiable for survival. Scaringe also touches on the upcoming R2 model, the importance of market choice, and how superior, proprietary data will be the key differentiator in the age of AI-driven vehicles.

Sparse Activation is the Future of AI (with Adrian Kosowski)

Sparse Activation is the Future of AI (with Adrian Kosowski)

Adrian Kosowski from Pathway explains their groundbreaking research on sparse activation in AI, moving beyond the dense architectures of transformers. Their model, Baby Dragon Hatchling (BDH), mimics the brain's efficiency by activating only a small fraction of its artificial neurons, enabling a new, more scalable, and compositional approach to reasoning that isn't confined by the vector space limitations of current models.

The Moonshot Podcast Deep Dive: Jeff Dean on Google Brain’s Early Days

The Moonshot Podcast Deep Dive: Jeff Dean on Google Brain’s Early Days

Google DeepMind’s Chief Scientist Jeff Dean discusses the origins of his work on scaling neural networks, the founding of the Google Brain team, the technical breakthroughs that enabled training massive models, the development of TensorFlow and TPUs, and his perspective on the evolution and future of artificial intelligence.

The Moonshot Podcast Deep Dive: Andrew Ng on Deep Learning and Google Brain

The Moonshot Podcast Deep Dive: Andrew Ng on Deep Learning and Google Brain

Andrew Ng, founder of Google Brain and DeepLearning.AI, discusses the history of neural networks and the foundational ideas that led to modern AI breakthroughs. He covers the controversial early bets on scale and general-purpose algorithms, the technical innovations behind Transformers, and the future democratizing effect of artificial intelligence.