Cost efficiency

Your Agents Need a Save Button - Hamza Tahir, ZenML

Your Agents Need a Save Button - Hamza Tahir, ZenML

Most AI agents lack a "save button" for persistent state, making debugging and optimization challenging. This talk introduces the concept of a durable runtime with checkpointing, allowing developers to replay agent executions, perform "what-if" analyses (e.g., swapping models, mocking tools), and conduct cohort-based evaluations using production data. The open-source tool Kitaru is demonstrated as a solution to build, debug, and improve agents at scale by capturing full execution state, not just traces.

State of the Union: Why Local, Why Now — NVIDIA, Osmantic, Roboflow, EXO Labs, @matthew_berman

State of the Union: Why Local, Why Now — NVIDIA, Osmantic, Roboflow, EXO Labs, @matthew_berman

This panel discussion explores the inflection point of Local AI, driven by advanced models, improved hardware, and a robust ecosystem. Experts discuss how this shift addresses critical concerns around privacy, cost, sovereignty, and resilience, emphasizing the pivotal role of open-source AI and specialized models. They delve into technical optimizations, the evolution from generalized to specialized AI, and the challenges of making local AI accessible and performant for both enterprise and individual users.

The Golden Age of AI Engineering — Alexander Embiricos & Romain Huet & Peter Steinberger, OpenAI

The Golden Age of AI Engineering — Alexander Embiricos & Romain Huet & Peter Steinberger, OpenAI

OpenAI's Romain Huet and Alexander Embiricos, joined by Peter Steinberger, outline the explosive progress of Codex at Dev Day 2024. They highlight the shift from manual coding to managing autonomous agents, enabled by rapid model iteration (every 6 weeks), open-source developer tools, and optimizations for cost-effectiveness ($1/M input tokens) and blazing inference speed (750 tokens/sec). The discussion centers on empowering AI engineers, not replacing them, by evolving agent capabilities, fostering an open ecosystem, and addressing future challenges like seamless local/cloud task execution and human attention as the new bottleneck in agent orchestration.