Reinforcement learning

Jul 28, 2026

AI tools for Forward Deployed Engineering — Vasuman Moza, Varick Agents

Varick Agents tackles the enterprise AI adoption challenge by deploying Forward Deployed Engineers (FDEs) who map, re-engineer, and automate complex workflows directly on top of existing systems, avoiding costly migrations. The company develops specialized internal AI tooling, including 'Engagement' and 'Workflow' agents, and employs custom model training with RL environments to overcome frontier model limitations in context extraction and clarity, enabling department-wide AI transformation.

Jul 23, 2026

Local Agentic Theory For Mobile Games — Shafik Quoraishee & Joanne Song, The New York Times

This presentation explores the innovative concept of running agentic AI entirely on mobile devices to enhance game accessibility and personalization. It delves into the technical challenges of local AI (space, time, energy budgets), contrasts agentic systems with traditional reinforcement learning, and demonstrates practical applications with a Space Invaders agent and a crossword solver. A key takeaway is the transformation of accessibility from fixed toggles to dynamic, real-time adjustments based on player needs, ultimately envisioning a future of billions of small, personalized local AI brains.

Jul 21, 2026

Is Fine-Tuning Still Needed? LLMs, RAG, & LoRA

This summary explores the evolving role of fine-tuning in modern AI workflows, comparing it with advanced techniques like RAG, LoRA, and enhanced generative AI capabilities. It discusses the historical benefits, current limitations due to rapidly advancing frontier models, and outlines a practical decision framework for customizing machine learning models and designing efficient AI systems.

Jul 17, 2026

Research to Reality with Google DeepMind — Benoit Schillings, Google DeepMind, VP of Technology

Benoit Schillings, VP of Technology at Google DeepMind, explores the evolution of AI's role in software development, highlighting the transition from human-limited coding to an AI frontier where syntax generation is solved. He delves into the power of self-play for model training, the shifting economics of software engineering, and the imperative for active guardrails. Schillings also discusses the need for inductive architecture, advanced model planning, multimodal reasoning (as seen in Gemini), and the potential for AI to drive scientific breakthroughs in fields like chemistry and biology by uncovering patterns imperceptible to human bias.

Jul 17, 2026

AI Can't Learn The Way Humans Do - This Could Fix That

This discussion explores world models as a promising path to solving sample efficiency in AI and achieving AGI. It contrasts deterministic control (Newtonian physics) with stochastic environments (RL), explaining the challenges posed by large action spaces in Go, self-driving, and robotics. The episode delves into how synthetic data, video diffusion models, and latent space architectures like JEPA are making world models practical, while also highlighting remaining open problems in physics modeling, real-time adaptation, and rich sensory integration.

Jul 15, 2026

Computer-Use 2.0: Agents Just Got Multi-Cursor — Francesco Bonacci, Cua

This talk introduces cua driver, an open-source tool enabling AI agents to interact with computer GUIs in the background across macOS, Windows, and Linux by leveraging accessibility APIs. It details CUABench, a robust evaluation framework with over 130 verifiable tasks designed to benchmark and ensure the trustworthiness of computer-using agents, revealing current limitations in complex tasks like circuit design. Finally, it presents cua fleet, an infrastructure solution that optimizes GPU utilization and reduces costs for RL training of these agents by dynamically managing sandbox environments.