Mike Krieger, a former CPO at Anthropic, details his transition to an IC role to build directly with AI, advocating for "unreasonable" asks like porting entire codebases. He shares lessons from Instagram on scaling and highlights Anthropic's internal use of Claude as a proactive teammate, flexible lab structure, and critical insights on AI product design, vertical applications, and mental health in the fast-paced AI industry.
Zoubin Ghahramani, a leading researcher at Google DeepMind and professor at Cambridge, argues that incorporating uncertainty is a missing piece for ever-improving AI. He discusses the critical difference between correctness and confidence in AI, tracing the historical evolution of probabilistic models from early neural networks to modern Bayesian approaches. Ghahramani highlights how current large language models often 'fake' uncertainty and explores successful implementations in areas like weather forecasting and AlphaFold, ultimately advocating for architectural innovations over pure scale to build more robust, trustworthy, and human-aligned intelligent systems that understand their own limitations.
This podcast episode delves into the pragmatic realities of building and deploying voice agents in enterprise. Featuring leaders from Decagon, Vapi, Retell, Daily, and Smallest AI, the discussion uncovers why the current state-of-the-art relies on cascaded pipelines (STT -> LLM -> TTS) instead of direct voice-to-voice models. Key challenges explored include managing latency versus intelligence, ensuring system reliability through fallback models, the complexities of turn-taking, and architectural strategies to overcome LLM context limitations and optimize costs. The experts also touch upon the differences between inbound and outbound use cases, multilingual considerations, and the potential future of hybrid voice agent architectures.
This video contrasts deterministic business rules with probabilistic AI agents for enterprise decision-making. It argues that instead of one superseding the other, a hybrid approach combining rules-first processing with AI agent escalation for complex, unstructured, or judgment-heavy cases, augmented by deterministic guardrails and human oversight, leads to optimal automation.
Maarten Grootendorst discusses the foundational understanding developers need for modern AI tools, emphasizing core LLM concepts like tokens, embeddings, and attention. He provides a pragmatic view on AI agents, distinguishing hype from practical applications like coding assistants, and explores the role of memory, guardrails, and the growing importance of open-weight models for control and efficiency in AI infrastructure.
Experiments with an AI tutor reveal that not compacting context often outperforms summarization, leading to better recall, lower cost, and faster responses, primarily due to LLM API prompt caching. Compaction invalidates the cache, making it unexpectedly expensive. While cloud environments benefit from full history, local hardware limits necessitate compaction, highlighting the need to prioritize actual constraints over default compaction strategies.