Feedback loops

Building uReview, Uber’s Multi-Agent Code Review Engine — Will Bond & Ameya Ketkar, Uber

Building uReview, Uber’s Multi-Agent Code Review Engine — Will Bond & Ameya Ketkar, Uber

Uber's Will Bond and Ameya Ketkar present uReview, an in-house automated code review system developed to combat rising review times (3 to 9 hours for first review). They detail why Uber built it over buying—due to Phabricator, agentic SDLC integration, and distributed ownership—and its architecture, including comment deduplication. The presentation highlights their iterative approach using advanced observability (sentiment, addressal rate, agent trajectory) to tune model performance, acknowledging that "the model never knows that it is wrong." They discuss empowering hundreds of teams with custom review agents and skills, sharing impressive results: 25,000 comments weekly, 67% addressal rate, and 60% cost reduction. Finally, they explore the evolving role of human engineers in an agentic SDLC, predicting an "expanded outer loop" focused on architecture and domain expertise rather than direct code review.

Reading Group July 2026 - Loop Engineering

Reading Group July 2026 - Loop Engineering

This session provides an in-depth exploration of Loop Engineering, a paradigm shift from manual AI prompting to designing autonomous systems that orchestrate AI agents. Speakers share practical experiences, from building production-grade platforms with automated code generation and adversarial AI reviews to experimental loop structures and foundational infrastructure layers. Key discussions address challenges like managing token costs, preventing agent chaos, and implementing robust verification mechanisms for industrializing software development.

Building Closed-Loop Evals for a Multimodal Agent at Scale — Soumya Gupta & Jai Chopra, Uber

Building Closed-Loop Evals for a Multimodal Agent at Scale — Soumya Gupta & Jai Chopra, Uber

This talk details how Uber Eats designed and implemented a multimodal AI agent to enhance food photography for independent merchants, addressing challenges like maintaining authenticity, merchant brand, and marketplace diversity while operating at scale. It covers the intricate evaluation strategies for routing and image editing agents, including continuous learning loops, managing drift, countering reward hacking, and balancing creative freedom with rigid safety guardrails. The speakers explain how they built a closed feedback loop combining offline human labeling, internal dogfooding, and online production signals to ensure robust and adaptive performance.

Build AI Systems for Discernment, Not Approval - Angel Ortmann Lee, Duolingo

Build AI Systems for Discernment, Not Approval - Angel Ortmann Lee, Duolingo

The talk addresses the critical flaw in human-in-the-loop AI: humans often surrender cognitive effort, leading to "automation bias" rather than true discernment. Through a Duolingo English Test case study and various interaction design examples, it demonstrates how engineering the human-AI interface—rather than just the model or oversight—can elicit critical thinking, generate high-quality data, and foster a virtuous cycle of AI improvement.

Simplicity • Pragmatic Dave Thomas & Sarah Taraporewalla

Simplicity • Pragmatic Dave Thomas & Sarah Taraporewalla

Dave Thomas, co-author of 'The Pragmatic Programmer,' discusses his new book 'Simplicity,' arguing that modern Agile has failed. He introduces his Orient-Step-Learn framework as a path for individual developers to regain agency, build intuition through deliberate practice, and master the art of creating minimal, elegant solutions by cutting away complexity.