On device ai

Local Agentic Theory For Mobile Games — Shafik Quoraishee & Joanne Song, The New York Times

Local Agentic Theory For Mobile Games — Shafik Quoraishee & Joanne Song, The New York Times

This presentation explores the innovative concept of running agentic AI entirely on mobile devices to enhance game accessibility and personalization. It delves into the technical challenges of local AI (space, time, energy budgets), contrasts agentic systems with traditional reinforcement learning, and demonstrates practical applications with a Space Invaders agent and a crossword solver. A key takeaway is the transformation of accessibility from fixed toggles to dynamic, real-time adjustments based on player needs, ultimately envisioning a future of billions of small, personalized local AI brains.

Frontier results, on device - RL Nabors, Arize

Frontier results, on device - RL Nabors, Arize

RL Nabors discusses the significant costs associated with using frontier AI models, covering security, latency, and financial implications. She introduces a framework for right-sizing AI solutions by leveraging smaller, task-specific models and Small Language Models (SLMs). The framework details how to prove task feasibility, establish success criteria with golden datasets, conduct capability evaluations (using tools like Phoenix), and select the most appropriate "Small And Good Enough" (SAGE) model. Nabors further demonstrates how prompt engineering, particularly few-shot prompting, and post-processing can close performance gaps with larger models, while advocating for continuous regression evaluations to maintain performance integrity. The overarching message is to "prototype big, deploy small" to optimize AI deployments.

Sovereign Escape Velocity: Ownership w Open Models — Gus Martins, & Ian Ballantyne, Google DeepMind

Sovereign Escape Velocity: Ownership w Open Models — Gus Martins, & Ian Ballantyne, Google DeepMind

Google DeepMind's Ian Ballantyne and Gus Martins introduce Gemma 4, a family of open models delivering state-of-the-art performance with remarkable size efficiency. They discuss how models like the 31B variant outperform competitors 2-20x its size while running on a single GPU, the shift to an Apache 2.0 license to foster sovereignty and adoption, and the new economics of running powerful agentic workloads on hardware ranging from a Pixel phone to a single enterprise GPU.

⚡️ Google's Open AI Strategy — Omar Sanseviero, Google DeepMind

⚡️ Google's Open AI Strategy — Omar Sanseviero, Google DeepMind

An in-depth look at Gemma 4's novel transformer architecture with per-layer embeddings, enabling efficient parameter offloading for on-device inference. The discussion also covers its native multimodality, the state of fine-tuning, text-based diffusion models, and the growing intersection of research and engineering.

Prompt to Pipeline: Building with Google's Gen Media Stack — Paige & Guillaume, Google DeepMind

Prompt to Pipeline: Building with Google's Gen Media Stack — Paige & Guillaume, Google DeepMind

A comprehensive overview of Google DeepMind's latest advancements, featuring Paige Bailey demonstrating Gemini 1.5 Flash's cost-effective video analysis and AI Studio's single-prompt app generation. Guillaume Vernade showcases a full generative media pipeline, turning a public domain book into an illustrated, animated, and scored project using Gemini, Nano Banana, VO, and LIA. Ian Valentine closes with the power of Gemma 4, demonstrating on-device, multi-agent code generation and debugging without cloud APIs.

AI on Android: Ask me Anything — Florina Muntenescu & Oli Gaymond, Google DeepMind

AI on Android: Ask me Anything — Florina Muntenescu & Oli Gaymond, Google DeepMind

Android provides a comprehensive AI strategy through AI Core, which manages the on-device Gemini Nano model. Developers can use the ML Kit GenAI APIs for easy access, with a hybrid inference option to fall back to the cloud for broader device support, ensuring both performance and reach.