A technical breakdown of three distinct approaches for implementing Multimodal Retrieval-Augmented Generation (RAG), moving from simple text conversion to fully integrated cross-modal systems. The discussion covers the architecture, trade-offs, and capabilities of each method.
Bhuvaneswari Subramani details the "Agentic Shift" in AI by presenting an evolutionary journey through seven foundational system design patterns. The talk progresses from simple conversational clients to sophisticated, multi-agent systems, covering key patterns like Retrieval-Augmented Generation (RAG), Self-Correcting RAG, and the Model Context Protocol (MCP), explaining how each pattern adds new layers of context, action, and autonomy.
Jeff Huber, CEO of Chroma, discusses "context rot," the degradation of AI performance in large context windows, and outlines a new vision for retrieval infrastructure. He covers the evolution of search, the importance of a two-stage recall-then-precision pipeline, and the challenges of agentic memory, advocating for a shift from AI "alchemy" to reliable engineering.
Biswaroop Bhattacharjee from Prem AI discusses Cortex, a novel AI memory system inspired by human cognition. The conversation explores moving beyond traditional flat memory structures to hierarchical, context-aware systems that enable more sophisticated and less noisy retrieval for AI agents.
A deep dive into building expert AI systems using a Wisdom-Driven Knowledge Graph. This approach enhances Knowledge-Augmented Generation (KAG) to surpass traditional Retrieval-Augmented Generation (RAG) by enabling systems to understand, reason, and provide expert-level quantitative analysis and advice.
David Karam, formerly of Google Search, presents a pragmatic framework for enhancing RAG systems, advocating a "quality engineering" approach. The talk progresses through a ladder of techniques, from in-memory retrieval and BM25 to custom embeddings, re-ranking, and advanced orchestration, emphasizing that the choice of technique should be driven by empirical analysis of system failures ("loss analysis") and balanced by a "complexity-adjusted impact" mindset.