Rag

Agents Are Where Microservices Were in 2015 — Roberto Milev & Uday Kanagala, Navan

Agents Are Where Microservices Were in 2015 — Roberto Milev & Uday Kanagala, Navan

Roberto Milev and Uday Kanagala from Navan discuss the challenges and emerging best practices in building and operating AI agents, drawing parallels with microservices. They highlight the shift to stateful runtimes, innovative memory and context management using 'skills,' and crucial solutions for observability and testing non-deterministic systems. A central theme is the critical need for robust authorization and guardrails, given the blurring line of agentic action, and a preference for mastering single-agent loops before scaling to complex orchestrations. They conclude by outlining the solved and unsolved problems, with cost and debugging remaining significant hurdles.

LLM & AI Agent Benchmarks vs Reality: Why AI Applications Break

LLM & AI Agent Benchmarks vs Reality: Why AI Applications Break

LLM leaderboard scores often don't reflect real-world performance. This video explains why and outlines a comprehensive approach to evaluate AI systems, focusing on the critical balance of accuracy, latency, and cost. It details model and system evaluation techniques, including handling different inference phases, workload shapes, and specific considerations for AI agents, emphasizing the need for realistic testing over generic benchmarks.

Why Most AI Agents Fail Horribly

Why Most AI Agents Fail Horribly

Maarten Grootendorst discusses the foundational understanding developers need for modern AI tools, emphasizing core LLM concepts like tokens, embeddings, and attention. He provides a pragmatic view on AI agents, distinguishing hype from practical applications like coding assistants, and explores the role of memory, guardrails, and the growing importance of open-weight models for control and efficiency in AI infrastructure.

AI & Data Science Periodic Tables: How They Work Together

AI & Data Science Periodic Tables: How They Work Together

Aaron Baughman and Martin Keen present a unified framework using "periodic tables" to integrate AI and Data Science. They illustrate how elements like pipelines, embeddings, and RAG combine to build real-world AI applications, using a detailed document Q&A system example. The discussion emphasizes the critical interdependence of data science in grounding AI models and ensuring continuous improvement through an innovative feedback loop.

The RAG Mistake Almost Every Team Is Making (with Pete Johnson)

The RAG Mistake Almost Every Team Is Making (with Pete Johnson)

Pete Johnson, Field CTO of AI at MongoDB, discusses effective AI strategies, why most organizations struggle with AI ROI, and how to build reliable AI systems. He covers the importance of choosing the right embedding models for RAG pipelines, introduces Matryoshka embeddings, and explains the evolution of agentic memory to combat token maxing and ensure consistency in production AI.

Understanding AI Agent Hallucination in AI Systems

Understanding AI Agent Hallucination in AI Systems

Learn about AI hallucinations, why they occur in autonomous agents, and how they pose new risks as AI takes action. Discover key mitigation strategies including data grounding, tool-based reasoning, scope control, and human-in-the-loop interventions to ensure reliable AI performance.