Tokenless

Hybrid inference

AI on Android: Ask me Anything — Florina Muntenescu & Oli Gaymond, Google DeepMind

AI on Android: Ask me Anything — Florina Muntenescu & Oli Gaymond, Google DeepMind

Android provides a comprehensive AI strategy through AI Core, which manages the on-device Gemini Nano model. Developers can use the ML Kit GenAI APIs for easy access, with a hybrid inference option to fall back to the cloud for broader device support, ensuring both performance and reach.

Compilers in the Age of LLMs — Yusuf Olokoba, Muna

Compilers in the Age of LLMs — Yusuf Olokoba, Muna

Yusuf Olokoba, founder of Muna, details a compiler-based approach to transform Python AI functions into self-contained native binaries. This talk explores the technical pipeline, including custom AST-based tracing, type propagation, and the strategic use of LLMs for code generation, enabling a universal, OpenAI-style client for running any model on any platform.