Jul 24, 2026

Hugging Face breach: OpenAI’s model breaks containment

This episode of Mixture of Experts explores pivotal AI developments: OpenAI's model breaching containment, Claude's Fable disproving a mathematical conjecture, Moonshot AI's massive 2.8 trillion parameter Kimi K3, and Google's shift to smaller, more efficient Gemini Flash models. The panel discusses AI security, its role in scientific discovery, and the evolving market strategies for model deployment, highlighting the tension between scale and efficiency.

Jun 10, 2026

Stop Making Models Bigger, Make Them Behave — Kobie Crawdord, Snorkel

Snorkel.ai's research demonstrates how a 4-billion-parameter model, fine-tuned with Reinforcement Learning for under $500, significantly outperformed a 235-billion-parameter model on financial analysis tool-use tasks. The key was cultivating 'tool discipline' and error correction capabilities, rather than relying on sheer model size or deeper reasoning. Single-table training generalized effectively to harder multi-table problems, emphasizing the importance of targeted behavioral fixes identified through detailed evaluation rubrics.

Jun 10, 2026

Sovereign Escape Velocity: Ownership w Open Models — Gus Martins, & Ian Ballantyne, Google DeepMind

Google DeepMind's Ian Ballantyne and Gus Martins introduce Gemma 4, a family of open models delivering state-of-the-art performance with remarkable size efficiency. They discuss how models like the 31B variant outperform competitors 2-20x its size while running on a single GPU, the shift to an Apache 2.0 license to foster sovereignty and adoption, and the new economics of running powerful agentic workloads on hardware ranging from a Pixel phone to a single enterprise GPU.