A product engineer from Granola shares a candid account of the challenges in moving AI features from the playground to production. This talk covers the pitfalls of "one-shot" solutions like web search and generic prompts, and details Granola's strategy of building custom internal tracing and development tooling to create a tight, effective feedback loop for iteration.
This post explores the shift from costly legacy contact center software to multi-agent AI systems. It demonstrates how to build, monitor, and evaluate these complex agentic systems using the Weights & Biases AI Developer Platform, with a focus on tracing, quality assessment, and ensuring consistent customer support.
An exploration of how a single, structured trace, based on OpenTelemetry standards, offers a superior method for debugging, testing, and understanding AI agent behavior compared to traditional logging. Learn how programmatic access to traces enables robust evaluation and the creation of golden datasets for building more reliable autonomous systems.