CircleCI's Olaf Molenveld and AWS's Julian Wood explore the evolution of CI/CD, drawing parallels between managing production code and the 'factory' that builds it. They cover the shift to microservices pipelines, optimization strategies, platform engineering trends, and how AI is set to reshape DevOps by acting as an expert system for developers.
Ido Pesok from Vercel explains why LLM-based applications often fail in production despite successful demos, and presents a systematic framework for building reliable AI systems using application-layer evaluations ("evals").
Authors Anne Currie and Sarah Wells discuss the core principles of "The Cloud Native Attitude", defining it not as a specific technology stack but as a cultural mindset focused on removing bottlenecks and enabling rapid, iterative change. The summary covers the primacy of CI/CD, the evolution of orchestrators like Kubernetes, and how a cloud native approach is a critical enabler for building sustainable, green software.
A detailed summary of a workshop on building and deploying production-minded AI coding agents using Dagger. The session covers creating controlled, observable, and test-driven agent workflows and integrating them into CI/CD systems like GitHub Actions for automated, reliable software development.
Traditional benchmarks and leaderboards are insufficient for production AI. This summary details a practical, multi-layered evaluation strategy, moving from foundational system performance to factual accuracy and finally to safety and bias, using open-source tools like GuideLLM, lm-eval-harness, and Promptfoo.