Tom Brown, co-founder of Anthropic, shares his journey from a YC founder to a key figure behind AI's scaling breakthroughs. He discusses the discovery of scaling laws that underpinned GPT-3, the mission-driven founding of Anthropic, the surprising success of Claude for coding, and his perspective on what he calls "humanity's largest infrastructure buildout ever."
Members of Anthropic's interpretability team discuss their research into the inner workings of large language models. They explore the analogy of studying AI as a biological system, the surprising discovery of internal "features" or concepts, and why this research is critical for understanding model behavior like hallucinations, sycophancy, and long-term planning, ultimately aiming to ensure AI safety.
a16z's Martin Casado and Anjney Midha detail the dramatic shift in U.S. AI policy from a 'pause AI' stance, fueled by doomerism and flawed analogies, to a pro-innovation 'win the race' strategy. They discuss how China's progress shattered illusions of a U.S. lead, the strategic business case for open source AI, and the pragmatic promise of the new AI Action Plan.
Dwarkesh Patel and Noah Smith debate the definition of AGI, its economic implications, and timelines. They contrast an economic definition (automating white-collar work) with a cognitive one, exploring why current models lack economic value despite reasoning abilities due to a failure in 'continual learning'. The discussion covers the potential for explosive economic growth versus a collapse in consumer demand, the substitution vs. complementarity of human labor, and the geopolitical shift from population size to inference capacity as the basis of power.
Technologist Balaji Srinivasan joins a16z's Erik Torenberg and Martin Casado to discuss the limitations and societal impact of AI, framing the conversation around the concept of "Polytheistic AGI"—multiple, culturally-specific AIs—versus a singular, god-like intelligence. They explore the practical system-level constraints on AI, its surprising evolution, the critical role of cryptography in grounding AI in reality, and the future of work and security in an AI-driven world.
Ben Mann, co-founder of Anthropic, discusses the accelerating progress in AI, forecasting superintelligence by 2028. He details Anthropic's safety-first mission, the "Economic Turing Test" for AGI, the mechanisms of Constitutional AI, and why focusing on alignment created Claude's unique personality.