Ai architecture

9 Lessons Learned from Deploying GenAI at Scale • Garth Gilmour & Stuart Greenlees • GOTO 2025

9 Lessons Learned from Deploying GenAI at Scale • Garth Gilmour & Stuart Greenlees • GOTO 2025

Drawing from their experience at Liberty Mutual, a Fortune 100 company, Garth Gilmour and Stuart Greenlees share nine hard-won lessons from deploying Generative AI for 5,000 developers. This "from the trenches" talk moves beyond the hype to discuss the real-world challenges of scaling AI, including managing spiraling costs, the complexities of RAG, the difference between shipping and adoption, and the necessity of building a governed platform. They detail their mistakes, solutions, and the evolution of their strategy for architecture, developer education, and model management.

Building an Agentic Platform — Ben Kus, CTO Box

Building an Agentic Platform — Ben Kus, CTO Box

Ben Kus, CTO of Box, outlines the technical evolution of their AI platform, detailing the transition from a promising but fragile LLM-based metadata extraction system to a robust, scalable agentic architecture. He explains why this shift was necessary to handle enterprise-level complexity and the key lessons learned.