An expert overview of post-training techniques for language models, covering the entire workflow from data generation and curation to advanced algorithms like Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and Reinforcement Learning (RL), along with practical advice on evaluation and iteration.
This talk introduces Anaximander, a system designed to bridge the gap between traditional, GUI-driven Geographic Information System (GIS) workflows and modern, code-heavy machine learning practices. Anaximander integrates geospatial foundation models directly into QGIS, allowing experts to interactively orchestrate, run, and evaluate models for tasks like semantic segmentation and object detection on satellite imagery.
At Applied Compute, efficient Reinforcement Learning is critical for delivering business value. This talk explores the transition from inefficient synchronous RL to a high-throughput asynchronous 'Pipeline RL' system. The core challenge is managing 'staleness'—a side effect of in-flight weight updates that can destabilize training. The speakers detail their first-principles systems model, based on the Roofline model, used to simulate and find the optimal allocation of GPU resources between sampling and training, balancing throughput with algorithmic stability and achieving significant speedups.
Zevi Arnovitz, a non-technical Product Manager at Meta, shares his complete workflow for building and shipping sophisticated applications using AI tools like Cursor. He details a structured, multi-step process that leverages different AI models for specific tasks, including a novel "peer review" technique where models critique each other's code.
![Why Every Brain Metaphor in History Has Been Wrong [SPECIAL EDITION]](https://img.youtube.com/vi/pO0WZsN8Oiw/maxresdefault.jpg)
An exploration of scientific simplification, questioning the metaphors we use to understand the brain and intelligence. This summary delves into the tension between creating useful models and mistaking them for reality, featuring insights on the mind-as-software debate, the limits of prediction versus understanding, and the philosophical underpinnings of our quest for AGI.
Thomas Wolf, co-founder of Hugging Face, discusses his journey from physics to AI, the power of open-source models to accelerate innovation, the practical challenges of productionalizing AI demos, and why the biggest opportunities for founders now lie in the application layer on top of powerful foundation models.
Jeff Crume and Patrick Fussell from IBM's X-Force team share a real-world ethical hacking war story, demonstrating an attack from an 'assume breach' perspective. They break down how vulnerabilities in Identity and Access Management (IAM) and legacy systems can lead to a full compromise, starting from an insider threat and escalating to domain administrator privileges through advanced C2 attacks and lateral movement.
Nikesh Arora, CEO of Palo Alto Networks, shares his unconventional journey and leadership philosophy. He provides a masterclass in building a multi-platform company through strategic M&A, explains why founders should sometimes ignore customers, and reveals how to lead with conviction while managing imposter syndrome.
Stewart Butterfield, co-founder of Slack and Flickr, shares the product frameworks and leadership principles that guided his success. He delves into concepts like "utility curves" for feature investment, the "owner's delusion" in product design, and why focusing on "comprehension" is often more important than reducing friction. He also introduces powerful mental models for organizational effectiveness, such as combating "hyper-realistic work-like activities" and applying Parkinson's Law to team growth.
John Jumper, one of the creators of AlphaFold, discusses the journey of developing an AI system to solve the protein folding problem. He emphasizes that the breakthrough was driven more by novel research and a combination of "mid-scale ideas" than by raw data or compute scale alone. The talk covers the importance of blind-assessment benchmarks like CASP, the strategy of releasing a massive, accessible database to drive adoption and trust, and the unexpected ways the scientific community used the tool. He concludes by framing AI for science as a powerful amplifier for experimentalists, accelerating discovery by generating high-quality, testable hypotheses.
Pushmeet Kohli, head of AI for Science at DeepMind, discusses AlphaEvolve, an AI system that uses Large Language Models (LLMs) coupled with evolutionary search to discover novel, human-interpretable algorithms. He explains the architecture, from its predecessor FunSearch to the multi-agent "Co-scientist" system, and details breakthroughs in solving decades-old math problems and optimizing real-world systems like data center scheduling and chip design.
André Prager, former Chief Engineer at Wing, discusses the core engineering philosophy of simplicity and cost-effectiveness that enabled the drone delivery service. He covers the design of key systems like the passive charging pad, the intelligent winch, the non-powered autoloader, and the iterative process of making the drones acoustically unobtrusive.
Yishay Carmiel and Roy Zanbel of Apollo Defend explore the state of voice AI, detailing the shift from cascaded models to end-to-end speech-to-speech systems. They break down the imminent security threats, including accessible voice cloning and sophisticated agent-based attacks, and discuss the nascent defense mechanisms and the urgent need for a new layer of voice security for governments, enterprises, and consumers.
Jonathan Blow, creator of Braid and The Witness, discusses the design philosophy behind 'jai', a new systems programming language. He explains how 'jai' re-evaluates the cost-benefit analysis of manual memory management by providing powerful, low-friction tools for metaprogramming, introspection, and debugging, inspired by principles from functional programming.
Jarek Kutylowski, CEO of DeepL, discusses the company's technical strategy for competing with large language models in the translation space. He covers their focus on specialized model architectures, the critical role of curated data, the engineering challenges of building custom GPU data centers and large-scale inference systems, and the future of AI-driven translation in enterprise workflows.
Get updates straight to your inbox. No spam, just useful content.