Orchestration

AI Engineer Paris 2026 Opening Keynotes: Mistral, Langfuse & Sizzy | Day 1

AI Engineer Paris 2026 Opening Keynotes: Mistral, Langfuse & Sizzy | Day 1

The AI Engineer Paris 2026 main stage featured discussions on the historical impact of AI as a general-purpose technology, the evolving landscape of AI engineering towards sophisticated "software factories," and Mistral AI's strategic vision for building frontier AI, ensuring agentic safety, and addressing data sovereignty through advanced models and infrastructure.

Operating Distributed Inference Systems at Scale — Nishant Gupta & Naman Ahuja, Meta

Operating Distributed Inference Systems at Scale — Nishant Gupta & Naman Ahuja, Meta

Meta's Nishant Gupta and Naman Ahuja explain how AI inference, the company's fastest-growing workload, requires a dedicated orchestration layer akin to Kubernetes for virtual machines. They detail the unique challenges of LLM serving compared to traditional microservices, emphasizing the intricate coupling of infrastructure layers, the distributed transaction nature of requests, and a seven-axis framework for scheduling. The talk concludes with the imperative to optimize for "cost per successful task" and the necessity of an inference-specific control plane to manage the complex interplay of latency, cost, and throughput.

If we want them to do Knowledge Work, design them as Knowledge Agents — Benjamin Clavié, Mixedbread

If we want them to do Knowledge Work, design them as Knowledge Agents — Benjamin Clavié, Mixedbread

Benjamin Clavié argues that the industry has mistakenly generalized from the "easy case" of coding agents to the much harder domain of general knowledge work. He highlights that code offers durable, explicit cues and narrow tasks, while knowledge work involves implicit meaning, contextual understanding, and agents needing to reconstruct intent. Clavié traces human solutions through "tool loops" and "organization loops," demonstrating how optimized tools and hierarchical agentic structures (like searcher agents generating memos) are essential to overcome performance ceilings and significantly bridge the "oracle gap" between AI and human knowledge workers.

The Agent Behind the Curtain: Building the Oz Cloud Agent Platform — Safia Abdalla, Warp

The Agent Behind the Curtain: Building the Oz Cloud Agent Platform — Safia Abdalla, Warp

Safia Abdalla discusses Warp's cloud agent platform, emphasizing its core principle of absorbing complexity from the user. She details features like flexible sandboxes, multi-harness support, and API-driven agent orchestration. The talk highlights how agents manage Warp's open-source repository—from issue triage to PR review—and introduces the "potter's workshop" analogy as a superior model to the "software factory" for modern, human-centric software development.

The State of Model Routing — NVIDIA, Cognition, OpenRouter

The State of Model Routing — NVIDIA, Cognition, OpenRouter

A deep dive into model routing strategies for AI/ML production, featuring experts from Cognition, OpenRouter, and NVIDIA. Key topics include optimizing costs with multi-model systems, delegating tasks between frontier and smaller models, managing context efficiently (sidekicks, compaction), and adapting to dynamic task complexities. The panel discusses the fragility of naive routing, the cost implications of in-distribution vs. out-of-distribution tasks, and the evolution of auto-routers driven by real-world usage patterns like OpenClaw's heartbeats. Insights also cover NVIDIA's Flex Run for dynamic model sizing, hallucination probes for detecting model limitations, and the future of hybrid local/cloud routing and model collaboration.

Agentic Engineering vs Software Engineering: Beyond Vibe Coding

Agentic Engineering vs Software Engineering: Beyond Vibe Coding

Anna Gutowska explains the paradigm shift in software engineering towards "agentic engineering," where AI agents execute goals defined by developers. She differentiates this from traditional, AI-assisted, and vibe coding, highlighting the increased importance of human oversight, orchestration, and verification in a world of probabilistic AI systems, and how this redefines the developer's role.