The author analyzes the looming imbalance between rapid AI lab revenue growth and slower compute capacity expansion. He explores how this dynamic will likely drive up compute costs and favor highly efficient, frontier models, creating significant barriers to entry and reshaping the AI landscape in the coming years.
Barr Yaron's 2026 AI engineering survey reveals key trends: audio and image generation are rapidly gaining traction, while cost is now a primary engineering constraint. Agents are evolving to take actions within systems, but control mechanisms remain primitive. Evaluation (eval) is still the top infrastructure challenge. AI positively impacts job satisfaction and experimentation but also raises concerns about technical skill erosion and non-developers shipping code, fundamentally changing engineering culture. Predictions include a likely AGI declaration within five years and a shift away from Transformers as state-of-the-art.
Applied Intuition discusses the emergence of physical AI, its mission to put intelligence on a billion machines, and its latest platform, Dana, designed to democratize autonomous system development. The conversation covers the vast scope of physical AI beyond automotive, the unique challenges of real-world deployment (safety, data, hardware), the current state and future of self-driving cars and trucks, and the transformative potential of humanoids and world models. They also touch upon the geopolitical landscape of AI and the global ambitions of Applied Intuition.
Dan Farrelly, CTO of Inngest, addresses the rapid obsolescence of AI agent architectures (a 6-month half-life) caused by fast-evolving models and frameworks. He proposes a solution: decouple agent systems into three conceptual layers (Execution, Context, Compute) and prioritize a stable, durable Execution Layer. This 'brain' layer, responsible for flow, state, and retries, offers resumability, flexible invocation patterns, and comprehensive observability, allowing the 'knowledge' and 'hands' layers to change frequently without necessitating full architectural rewrites.
Katelyn Lesse and Angela Jiang, leaders of Anthropic's developer platform, outline their strategy built on a "three-layer cake": knowledge, execution, and coordination. They emphasize moving towards advanced "strategies" or meta-harnesses that assign distinct jobs to tokens, fostering a robust and open AI ecosystem. The discussion covers empowering builders, setting industry standards, and Anthropic's nuanced approach to an open platform versus a walled garden, focusing on architectural soundness over infrastructure ownership.
Modal CTO Akshat Bubna discusses the company's shift from developer to agent experience, highlighting why traditional cloud infrastructure fails for bursty AI workloads. He details Modal's primitives like elastic inference with GPU snapshotting and speculative decoding, agent sandboxes for RL rollouts, multi-node training with RDMA, and a "supercloud" strategy across 17 providers. The conversation also covers the importance of observability, hard guardrails for production agents, and AI's role in making infrastructure exciting again.