Atlassian Co-Founder & CEO Mike Cannon-Brookes shares insights from a massive internal study of over 10,000 engineers using AI coding tools. He discusses the true measures of developer productivity, the future of developer roles, and why human-AI collaboration, powered by organizational context, is the key to the future.
AI models show remarkable progress on benchmarks, yet a field study with experienced developers revealed no productivity gains. This summary explores the disconnect between lab results and real-world impact, examining the causal relationship between compute and AI capabilities, the nuances of the developer productivity study, and future directions for measuring what AI can truly do.
Chip Huyen provides a deep dive into the evolving landscape of AI-powered coding. The talk covers the different interfaces for AI coding tools, introduces new metrics like "interruption rate" to measure productivity, and outlines a framework for the levels of coding automation. Huyen argues that the engineer's role is shifting from writing code to architecting systems and reviewing AI-generated output, emphasizing the rise of spec-driven development and the critical importance of system thinking.
Drawing from their experience at Liberty Mutual, a Fortune 100 company, Garth Gilmour and Stuart Greenlees share nine hard-won lessons from deploying Generative AI for 5,000 developers. This "from the trenches" talk moves beyond the hype to discuss the real-world challenges of scaling AI, including managing spiraling costs, the complexities of RAG, the difference between shipping and adoption, and the necessity of building a governed platform. They detail their mistakes, solutions, and the evolution of their strategy for architecture, developer education, and model management.
In an era of the "Infinite Software Crisis" where AI-generated code outpaces human understanding, this talk argues for choosing "simple" design over "easy" generation. The speaker presents a three-phase methodology—Research, Planning, and Implementation—that forces developers to think critically before generating code. This approach leverages AI for mechanical tasks while ensuring that human judgment, context, and a deep understanding of the system remain the core of the software development process, turning human insight into the ultimate competitive advantage.
Alexander Embiricos, product lead for OpenAI's Codex, discusses the vision of AI as a proactive software engineering teammate, the product decisions that led to its explosive 20x growth, and why the real bottleneck to AGI-level productivity is shifting from model capability to human review speed.