Pablo Castro explores the three pillars of AI knowledge—intrinsic, extrinsic, and learned—explaining how models leverage parametric memory, agents integrate with enterprise data through sophisticated RAG systems like Foundry IQ, and how continuous learning loops, facilitated by tools like the Agent Optimizer, enable self-improving agents, driving the next wave of AI applications.
Mixedbread AI addresses the "Oracle Gap" – the disparity between LLM reasoning and retrieval capabilities – by developing agents trained to use advanced search tools effectively. They demonstrate how current LLMs generate poor queries due to training biases and introduce a sophisticated agent harness with diverse search tools and a unique training regimen, including supervised fine-tuning and reinforcement learning with custom rewards, to teach agents to form precise semantic queries. This approach significantly improves performance on benchmarks like Oblique Congress and Snowflake's Match QA, closing the gap between theoretical perfect retrieval and real-world agent performance.
Large language models are transforming search from a static, stateless process into a dynamic, agent-based reasoning system. This talk explores the practical patterns—like query rewriting, hybrid retrieval, and agent-based reranking—for building and deploying these 'agentic search' systems at scale, covering the architectural principles, production challenges, and the future trajectory where search itself may dissolve into understanding.
David Karam, formerly of Google Search, presents a pragmatic framework for enhancing RAG systems, advocating a "quality engineering" approach. The talk progresses through a ladder of techniques, from in-memory retrieval and BM25 to custom embeddings, re-ranking, and advanced orchestration, emphasizing that the choice of technique should be driven by empirical analysis of system failures ("loss analysis") and balanced by a "complexity-adjusted impact" mindset.
Will Bryk, CEO of Exa, explains why traditional keyword-based search is insufficient for AI agents and introduces a new paradigm of neural, semantic search. He demonstrates how a hybrid approach, combining neural for discovery and keyword for precision, enables AI agents to perform complex, multi-step information retrieval tasks that were previously impossible.
Philipp Krenn from Elastic demystifies the 'R' in RAG, arguing that modern retrieval is a sophisticated blend of classic keyword search (like BM25) and modern vector search. This workshop explores the fundamentals of lexical analysis, scoring, dense/sparse vectors, and advanced hybrid search techniques like Reciprocal Rank Fusion (RRF).