An expert overview of post-training techniques for language models, covering the entire workflow from data generation and curation to advanced algorithms like Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and Reinforcement Learning (RL), along with practical advice on evaluation and iteration.
This talk introduces Anaximander, a system designed to bridge the gap between traditional, GUI-driven Geographic Information System (GIS) workflows and modern, code-heavy machine learning practices. Anaximander integrates geospatial foundation models directly into QGIS, allowing experts to interactively orchestrate, run, and evaluate models for tasks like semantic segmentation and object detection on satellite imagery.
At Applied Compute, efficient Reinforcement Learning is critical for delivering business value. This talk explores the transition from inefficient synchronous RL to a high-throughput asynchronous 'Pipeline RL' system. The core challenge is managing 'staleness'—a side effect of in-flight weight updates that can destabilize training. The speakers detail their first-principles systems model, based on the Roofline model, used to simulate and find the optimal allocation of GPU resources between sampling and training, balancing throughput with algorithmic stability and achieving significant speedups.
A discussion on the evolving cybersecurity landscape, covering the persistent threat of ransomware gangs adapting with AI, the critical failures in identity security highlighted by the Zestix case, the emergence of AI agents as a new class of insider threats, and the physical-world risks demonstrated by hacking humanoid robots.
In a discussion with Astro Teller, Emily Ma from X (formerly Google X) delves into the multifaceted problem of food waste and the moonshot projects developed to tackle it. They explore Project Delta, an initiative that created an "air traffic control" system for surplus food, and Project Chorus, a broader supply chain moonshot designed to give every object a voice through advanced sensors and software.
Ben Horowitz of Andreessen Horowitz discusses how AI is reshaping venture capital, detailing the firm's strategy for managing partners, verticalizing teams, and evaluating investments in real-time. He breaks down the current AI cycle, arguing that application design and model orchestration are key, and explains why the current market's growth is driven by real demand, not just hype.
Nikesh Arora, CEO of Palo Alto Networks, shares his unconventional journey and leadership philosophy. He provides a masterclass in building a multi-platform company through strategic M&A, explains why founders should sometimes ignore customers, and reveals how to lead with conviction while managing imposter syndrome.
Stewart Butterfield, co-founder of Slack and Flickr, shares the product frameworks and leadership principles that guided his success. He delves into concepts like "utility curves" for feature investment, the "owner's delusion" in product design, and why focusing on "comprehension" is often more important than reducing friction. He also introduces powerful mental models for organizational effectiveness, such as combating "hyper-realistic work-like activities" and applying Parkinson's Law to team growth.
Intuit CEO Sasan Goodarzi discusses the operational playbook for reinventing a 40-year-old company, from its slow transition to SaaS to its early adoption of AI. He shares insights on winning the SMB market by treating small businesses like consumers, building effective channel partnerships, and developing a platform strategy. Goodarzi also details his leadership philosophy, emphasizing that grit and curiosity are more critical than raw talent.
Jordan Fisher, co-founder of Standard AI and now at Anthropic, poses critical questions for startup founders facing the imminent arrival of AGI. He explores challenges from software commoditization and building trust in automated teams to finding durable moats and the ethical responsibility of building world-changing technology.
Engineer and author Piotr Sarna discusses his evolution from a reluctant writer to a book author, detailing a pattern-based approach to creating high-quality technical content and overcoming the common fears engineers face when writing.
Exploring the evolution of AI, this summary breaks down the Data-Information-Knowledge-Wisdom hierarchy, revisits past predictions about AI's limits that have since been surpassed—such as reasoning and creativity—and delves into current challenges like hallucinations, AGI, and sustainability. It concludes by framing a collaborative future where humans define the 'what' and 'why,' while AI executes the 'how'.
Adrian Kosowski from Pathway introduces the Baby Dragon Hatchling (BDH), a groundbreaking, post-transformer architecture inspired by neuroscience. BDH leverages sparse, positive activation to mimic brain function, offering a path to limitless context, superior reasoning, and unprecedented computational efficiency, potentially solving key limitations of current large language models.
Sam Altman's DevDay 2025 keynote introduces major platform updates, including the Apps SDK for building inside ChatGPT, AgentKit for streamlined agent creation, the general availability of the powerful Codex coding agent, and new API access to GPT-5 Pro and Sora 2.
Microsoft’s Eric Horvitz and guests discuss the Paraphrase Project, a two-year red-teaming effort that uncovered and patched a significant biosecurity vulnerability, demonstrating a model for responsibly managing the dual-use risks of generative AI in protein design.
Get updates straight to your inbox. No spam, just useful content.