Jev is a System 1 AI model from TypeSafe that skips text generation entirely, returning calibrated probabilities for fixed-option questions in a single fast request. This explores how it works, how it is trained with reinforcement learning for calibrated decisions, how its probabilities drive software thresholds and guardrails, and how it can complement LLMs in workflows.
Lakshya Agrawal, creator of GEPA and a PhD student at UC Berkeley's Sky Computing Lab, presents reflective optimization as an alternative to scalar-reward reinforcement learning. GEPA lets a model read full rollout traces, including reasoning, tool calls, and error messages, and rewrite prompts from that feedback, with a Pareto candidate pool guarding against local optima. The talk covers the GEPA vs. GRPO sample-efficiency comparison, domain-knowledge discovery, the Optimize Anything API for text-based artifacts like code, harnesses, and skills, and production results from Databricks, Snorkel, and others.
Suchet Bargoti, Skydio's Director of Inspection and Mapping, demos a fleet of docked drones orchestrated through an agentic layer, then explains how full-stack autonomy, maps as world models, edge-cloud splitting, VLM-driven tracking and the limits of end-to-end learning combine to make drones function as infrastructure.
Sarvam introduces Vision India, a 3B parameter Vision Language Model achieving state-of-the-art in document AI for English and 22 Indian languages. It leverages a State Space Model (SSM) backbone for efficiency with long documents and a novel block-level OCR approach. A four-stage training curriculum, including advanced RL with verifiable rewards, and a robust data engine for low-resource languages underpin its superior performance, enabling the digitization of millions of pages for critical sectors.
A deep dive into the evolving world of LLM harnesses, demonstrating how they've transformed from simple prompt engineering into sophisticated self-improving systems. The discussion covers architectural advancements (e.g., Prime Agent's context as cache, Turing vs. Von Neumann), practical applications (auto-researchers, on-device personal AI like OpenJarvis, YC's QM for work), and the challenges and future directions of agentic AI. It emphasizes that harness innovation is key to unlocking significant performance gains and enabling LLMs to operate autonomously and adaptively.
Abi Aryan discusses the shift from MLOps to LLMOps, framing generative AI deployment as a distributed systems challenge. She highlights the critical role of FinOps due to high model costs, the need for custom tooling over generic agent frameworks, and the importance of a 'decision layer' for agent autonomy. Observability is re-conceptualized as anomaly detection, and she points to dynamic RL environments and strong data engineering as future research priorities and essential skills for AI engineers.