Martin Keen explains how Long Context and Cache Augmented Generation (CAG) serve as powerful alternatives to RAG for providing external knowledge to LLMs. This summary details the mechanics of each approach, the role of the KV cache, the practical application through prompt caching, and the trade-offs in performance, cost, and latency for real-world AI workloads.
Cerebras CEO Andrew Feldman discusses the company's journey from a contrarian bet on wafer-scale computing to a $63 billion public company. He details the technical breakthroughs, the challenge of being ahead of the market, and how the recent explosion in AI demand for fast inference validated their architecture, leading to a landmark $20 billion deal with OpenAI.
Tianyi Zhu from MathWorks explains the key differences between AI agents and chatbots, highlighting how agentic AI acts as a powerful amplifier for engineers. The discussion covers practical use cases in MATLAB and Simulink, measurable ROI in automotive workflows, and strategies for safely integrating non-deterministic AI into high-stakes engineering environments.
A deep dive into Despegar's GenAI travel agent, Sofia. Explore its multi-agent architecture, the custom orchestration layer 'Chappi' built before MCP was a standard, and the strategy of decentralizing agent development across company squads to cover the entire five-phase travel arc.
Ekaterina Sirazitdinova from NVIDIA provides a high-level overview of the latest trends shaping the future of AI, covering the evolution from early deep learning to the rise of agentic and physical AI, and diving deep into the critical optimization techniques required to deploy these powerful models efficiently.
This week's podcast delves into the rapidly evolving landscape of AI-powered vulnerability management, discussing OpenAI's Daybreak, Microsoft's MDASH, and Mistral's Mythos competitor. The panel analyzes the measured real-world results of Anthropic's Mythos on the curl project and explores the implications of the notorious Shai-Hulud npm worm going open source.