An expert overview of post-training techniques for language models, covering the entire workflow from data generation and curation to advanced algorithms like Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and Reinforcement Learning (RL), along with practical advice on evaluation and iteration.
This talk introduces Anaximander, a system designed to bridge the gap between traditional, GUI-driven Geographic Information System (GIS) workflows and modern, code-heavy machine learning practices. Anaximander integrates geospatial foundation models directly into QGIS, allowing experts to interactively orchestrate, run, and evaluate models for tasks like semantic segmentation and object detection on satellite imagery.
At Applied Compute, efficient Reinforcement Learning is critical for delivering business value. This talk explores the transition from inefficient synchronous RL to a high-throughput asynchronous 'Pipeline RL' system. The core challenge is managing 'staleness'—a side effect of in-flight weight updates that can destabilize training. The speakers detail their first-principles systems model, based on the Roofline model, used to simulate and find the optimal allocation of GPU resources between sampling and training, balancing throughput with algorithmic stability and achieving significant speedups.
In a discussion with Astro Teller, Emily Ma from X (formerly Google X) delves into the multifaceted problem of food waste and the moonshot projects developed to tackle it. They explore Project Delta, an initiative that created an "air traffic control" system for surplus food, and Project Chorus, a broader supply chain moonshot designed to give every object a voice through advanced sensors and software.
Ben Horowitz of Andreessen Horowitz discusses how AI is reshaping venture capital, detailing the firm's strategy for managing partners, verticalizing teams, and evaluating investments in real-time. He breaks down the current AI cycle, arguing that application design and model orchestration are key, and explains why the current market's growth is driven by real demand, not just hype.
Ashwin Rajeeva, cofounder and CTO of Acceldata, details the architecture and philosophy behind their Agentic Data Management (ADM) platform. He explains how the Xlake reasoning engine provides crucial context for AI agents to operate across petabyte-scale enterprise data, enabling capabilities like self-healing data pipelines and automated data quality assurance, while also discussing strategies for leading technical teams in the age of AI.
Nikesh Arora, CEO of Palo Alto Networks, shares his unconventional journey and leadership philosophy. He provides a masterclass in building a multi-platform company through strategic M&A, explains why founders should sometimes ignore customers, and reveals how to lead with conviction while managing imposter syndrome.
Stewart Butterfield, co-founder of Slack and Flickr, shares the product frameworks and leadership principles that guided his success. He delves into concepts like "utility curves" for feature investment, the "owner's delusion" in product design, and why focusing on "comprehension" is often more important than reducing friction. He also introduces powerful mental models for organizational effectiveness, such as combating "hyper-realistic work-like activities" and applying Parkinson's Law to team growth.
Intuit CEO Sasan Goodarzi discusses the operational playbook for reinventing a 40-year-old company, from its slow transition to SaaS to its early adoption of AI. He shares insights on winning the SMB market by treating small businesses like consumers, building effective channel partnerships, and developing a platform strategy. Goodarzi also details his leadership philosophy, emphasizing that grit and curiosity are more critical than raw talent.
Nicole Forsgren, creator of the DORA and SPACE frameworks, explains why traditional productivity metrics are failing in the age of AI. She details how AI impacts developer flow state, shifts the focus from writing to reviewing code, and provides a new framework for measuring and improving Developer Experience (DevEx) by aligning engineering efforts with strategic business goals.
![Why AI Needs Culture (Not Just Data) - Prolific [Sponsored]](https://img.youtube.com/vi/cnxZZTl1tkk/maxresdefault.jpg)
Sara Saab and Enzo Blindow from Prolific discuss the critical, and growing, need for high-quality human evaluation in the age of non-deterministic AI. They explore the limitations of current benchmarks, the dangers of agentic misalignment as revealed by Anthropic's research, and how Prolific is building a "science of evals" by treating human feedback as a robust infrastructure layer.
Hossein Hafezi from NYU presents IronDict, a novel transparent dictionary construction using polynomial commitment schemes. IronDict addresses the major limitations of existing Merkle tree-based systems, such as high auditing costs and imperfect privacy. By modeling the dictionary with polynomials and leveraging the algebraic properties of the KZH commitment scheme, IronDict achieves perfect privacy and dramatically reduces auditing overhead, making it feasible for end-users to verify the system's integrity on consumer devices.
Victor Youdom Kemmoe from Brown University presents a novel, communication-efficient cryptographic accumulator based on the Module-SIS assumption. This construction is designed for applications like anonymous credential revocation, where elements can be added without needing to update existing membership witnesses, a significant improvement over previous post-quantum schemes.
Varun Madathil from Yale University presents Tacita, a novel, single-server protocol for secure aggregation in Federated Learning (FL). Tacita is designed to address the unique constraints of the FL environment, such as client dropouts and the absence of client-to-client communication. The protocol achieves one-shot execution with constant-size communication and robustness against dropouts by introducing two new cryptographic primitives: succinct multi-key linearly homomorphic threshold signatures (MKLHTS) and a homomorphic variant of Silent Threshold Encryption.
Biswaroop Bhattacharjee from Prem AI discusses Cortex, a novel AI memory system inspired by human cognition. The conversation explores moving beyond traditional flat memory structures to hierarchical, context-aware systems that enable more sophisticated and less noisy retrieval for AI agents.
Get updates straight to your inbox. No spam, just useful content.