An expert overview of post-training techniques for language models, covering the entire workflow from data generation and curation to advanced algorithms like Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and Reinforcement Learning (RL), along with practical advice on evaluation and iteration.
This talk introduces Anaximander, a system designed to bridge the gap between traditional, GUI-driven Geographic Information System (GIS) workflows and modern, code-heavy machine learning practices. Anaximander integrates geospatial foundation models directly into QGIS, allowing experts to interactively orchestrate, run, and evaluate models for tasks like semantic segmentation and object detection on satellite imagery.
At Applied Compute, efficient Reinforcement Learning is critical for delivering business value. This talk explores the transition from inefficient synchronous RL to a high-throughput asynchronous 'Pipeline RL' system. The core challenge is managing 'staleness'—a side effect of in-flight weight updates that can destabilize training. The speakers detail their first-principles systems model, based on the Roofline model, used to simulate and find the optimal allocation of GPU resources between sampling and training, balancing throughput with algorithmic stability and achieving significant speedups.
Thomas Wolf, co-founder of Hugging Face, discusses his journey from physics to AI, the power of open-source models to accelerate innovation, the practical challenges of productionalizing AI demos, and why the biggest opportunities for founders now lie in the application layer on top of powerful foundation models.
Daren Fields, Co-Founder & CEO of Virtual Select, discusses the future of manufacturing, emphasizing the role of AI as a tool for human augmentation, not replacement. He explores how to modernize manufacturing by combining a carbon-based workforce with silicon-based systems to prevent defects, reduce costs, and de-risk execution.
The panel discusses Anthropic's Claude Cowork and the challenge of user trust in AI agents for everyday tasks. They then analyze the Apple-Google partnership to integrate Gemini into Siri, debating its implications for edge AI, privacy, and hardware limitations. Finally, they explore Linus Torvalds' use of AI for "vibe coding," considering its impact on hobbyist programming and entrepreneurship versus the current limitations in producing production-ready software.
Jeff Crume and Patrick Fussell from IBM's X-Force team share a real-world ethical hacking war story, demonstrating an attack from an 'assume breach' perspective. They break down how vulnerabilities in Identity and Access Management (IAM) and legacy systems can lead to a full compromise, starting from an insider threat and escalating to domain administrator privileges through advanced C2 attacks and lateral movement.
Nikesh Arora, CEO of Palo Alto Networks, shares his unconventional journey and leadership philosophy. He provides a masterclass in building a multi-platform company through strategic M&A, explains why founders should sometimes ignore customers, and reveals how to lead with conviction while managing imposter syndrome.
Stewart Butterfield, co-founder of Slack and Flickr, shares the product frameworks and leadership principles that guided his success. He delves into concepts like "utility curves" for feature investment, the "owner's delusion" in product design, and why focusing on "comprehension" is often more important than reducing friction. He also introduces powerful mental models for organizational effectiveness, such as combating "hyper-realistic work-like activities" and applying Parkinson's Law to team growth.
OpenAI researchers discuss the step-change in capabilities in ChatGPT-5, from coding and reasoning to creative writing. They detail the data-centric training processes, the shift toward asynchronous agentic workflows, and the future of AI development and its impact on the startup ecosystem.
Matthew Prince, CEO of Cloudflare, discusses the internet's architectural and economic shift from a search-driven model to an AI-native one. He outlines the existential threat to content creators as AI consumes content without providing traffic, and proposes a new marketplace where creators are compensated for providing value and filling knowledge gaps, rather than generating clicks.
OpenAI introduces GPT-5, a significant upgrade focused on expert-level reasoning, agentic capabilities, and real-world utility, particularly for developers and enterprises. The model introduces a new reasoning paradigm, "software on demand" capabilities, and state-of-the-art performance on coding, reasoning, and long-context benchmarks. The launch also includes major updates to the ChatGPT application and a powerful new API for developers.
Dr. Umair Shah, former Washington State Secretary of Health, and Dr. Gianrico Farrugia, CEO of Mayo Clinic, discuss the practical applications and strategic imperatives of AI in public health and clinical care. They explore how AI can shift public health from a reactive to a proactive model, the necessity for a new data-centric architecture in healthcare systems, and the transformative potential of generative AI beyond mere optimization of current workflows.
A walkthrough of the NVIDIA Data Flywheel Blueprint, demonstrating how to use production data and Weights & Biases to systematically fine-tune AI agents. This process enhances model accuracy and efficiency by creating a continuous improvement cycle, moving beyond the limitations of prompt engineering.
Russ Miles shares his deeply personal and professional journey to define the principles of effective internal developer platform engineering. He argues for a shift from a technology-first approach to 'compassionate technical product stewardship,' using powerful metaphors like the 'ski resort' to illustrate how platforms should create safe, empowering habitats for developers to thrive.
Get updates straight to your inbox. No spam, just useful content.