Aug 12, 2025

913: LLM Pre-Training and Post-Training 101 — with Julien Launay

Julien Launay, CEO of Adaptive ML, discusses the evolution of Large Language Model (LLM) training, detailing the critical shift from pre-training to post-training with Reinforcement Learning (RL). He explains the nuances of RL feedback mechanisms (RLHF, RLEF, RLAIF), the role of synthetic data, and how his company provides the "RLOps" tooling to make these powerful techniques accessible to enterprises. The conversation also explores the future of AI, including scaling beyond data limitations and the path to a "spiky" AGI.

Aug 10, 2025

#define AI Engineer - Greg Brockman, OpenAI (ft. Jensen Huang, NVIDIA)

Greg Brockman discusses his journey from a math enthusiast to a programmer, his early days scaling Stripe, and the core philosophies that drive OpenAI. He covers the critical partnership between research and engineering, the future of coding with agentic systems, and the immense infrastructure and algorithmic challenges on the path to AGI.

Aug 04, 2025

Dwarkesh and Noah Smith on AGI and the Economy

Dwarkesh Patel and Noah Smith debate the definition of AGI, its economic implications, and timelines. They contrast an economic definition (automating white-collar work) with a cognitive one, exploring why current models lack economic value despite reasoning abilities due to a failure in 'continual learning'. The discussion covers the potential for explosive economic growth versus a collapse in consumer demand, the substitution vs. complementarity of human labor, and the geopolitical shift from population size to inference capacity as the basis of power.

Jul 29, 2025

Scaling and the Road to Human-Level AI | Anthropic Co-founder Jared Kaplan

Jared Kaplan, co-founder of Anthropic, explains how the discovery of predictable, physics-like scaling laws in AI training provides a clear roadmap for progress. He details the two main phases of model training (pre-training and RL), discusses how scaling compute predictably unlocks longer-horizon task capabilities, and outlines the remaining challenges—memory, nuanced oversight, and organizational knowledge—on the path to human-level AI.

Jul 28, 2025

Balaji Srinivasan: How AI Will Change Politics, War, and Money

Technologist Balaji Srinivasan joins a16z's Erik Torenberg and Martin Casado to discuss the limitations and societal impact of AI, framing the conversation around the concept of "Polytheistic AGI"—multiple, culturally-specific AIs—versus a singular, god-like intelligence. They explore the practical system-level constraints on AI, its surprising evolution, the critical role of cryptography in grounding AI in reality, and the future of work and security in an AI-driven world.

Jul 22, 2025

907: Neuroscience, AI and the Limitations of LLMs — with Dr. Zohar Bronfman

Zohar Bronfman discusses why current LLMs are not on a path to AGI, contrasting their combinatorial creativity with the transformational, domain-general intelligence of humans. He argues that predictive models, not generative ones, deliver the most business value and explains how his platform, Pecan AI, automates the critical data preparation bottleneck to democratize predictive analytics for all businesses.