An expert overview of post-training techniques for language models, covering the entire workflow from data generation and curation to advanced algorithms like Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and Reinforcement Learning (RL), along with practical advice on evaluation and iteration.
This talk introduces Anaximander, a system designed to bridge the gap between traditional, GUI-driven Geographic Information System (GIS) workflows and modern, code-heavy machine learning practices. Anaximander integrates geospatial foundation models directly into QGIS, allowing experts to interactively orchestrate, run, and evaluate models for tasks like semantic segmentation and object detection on satellite imagery.
At Applied Compute, efficient Reinforcement Learning is critical for delivering business value. This talk explores the transition from inefficient synchronous RL to a high-throughput asynchronous 'Pipeline RL' system. The core challenge is managing 'staleness'—a side effect of in-flight weight updates that can destabilize training. The speakers detail their first-principles systems model, based on the Roofline model, used to simulate and find the optimal allocation of GPU resources between sampling and training, balancing throughput with algorithmic stability and achieving significant speedups.
Anna Goldie and Azalia Mirhoseini of Ricursive Intelligence discuss how their work on Google's AlphaChip, which used AI to design TPUs, is now being extended to automate the entire chip design process. They explain their vision for a 'designless' industry and a recursive self-improvement loop where AI designs better chips, which in turn accelerates AI development.
This session from Okta and Auth0 introduces a comprehensive framework for securing AI agents, covering identity establishment, delegated API access via Token Vault, user consent for risky operations using Asynchronous Authorization (CIBA), and integration with MCP servers.
A discussion on the evolving cybersecurity landscape, covering the persistent threat of ransomware gangs adapting with AI, the critical failures in identity security highlighted by the Zestix case, the emergence of AI agents as a new class of insider threats, and the physical-world risks demonstrated by hacking humanoid robots.
Nikesh Arora, CEO of Palo Alto Networks, shares his unconventional journey and leadership philosophy. He provides a masterclass in building a multi-platform company through strategic M&A, explains why founders should sometimes ignore customers, and reveals how to lead with conviction while managing imposter syndrome.
Stewart Butterfield, co-founder of Slack and Flickr, shares the product frameworks and leadership principles that guided his success. He delves into concepts like "utility curves" for feature investment, the "owner's delusion" in product design, and why focusing on "comprehension" is often more important than reducing friction. He also introduces powerful mental models for organizational effectiveness, such as combating "hyper-realistic work-like activities" and applying Parkinson's Law to team growth.
Intuit CEO Sasan Goodarzi discusses the operational playbook for reinventing a 40-year-old company, from its slow transition to SaaS to its early adoption of AI. He shares insights on winning the SMB market by treating small businesses like consumers, building effective channel partnerships, and developing a platform strategy. Goodarzi also details his leadership philosophy, emphasizing that grit and curiosity are more critical than raw talent.
In a dynamic discussion, experts debate the merits of pricing H-1B visas versus the current lottery system, questioning what the policy should optimize for. They explore the real-world impact of AI on developer productivity, with Box reporting that 30% of its code now comes from AI, and highlight how small, senior teams are achieving superhuman results by shifting from writing code to reviewing it. The conversation also covers why bottom-up, personal AI tools are succeeding where top-down corporate pilots fail, and analyzes the platform shift, arguing that AI-native startups have a unique advantage in a landscape where incumbent scale is being neutralized by AI agents.
Dave Farley argues that modern software development should be treated as an engineering discipline, emphasizing an evolutionary and iterative approach to architecture and design. He outlines key principles for tackling complexity, focusing on optimizing for learning and ease of change through techniques like working in small steps, prioritizing testability, and managing coupling.
Panelists debate the likelihood of an "AI vulnerability cataclysm", discussing whether AI will overwhelm defenses or if it's an arms race where both attackers and defenders level up. The discussion covers the return of threat group Scattered Spider using AI-powered vishing, the persistent and significant risks of cloud misconfigurations, the emergence of firmware-level ransomware like HybridPetya, and the importance of focusing on security fundamentals and user education over punitive rules.
Dr. Jay Bhattacharya, Director of the NIH, discusses his vision for reforming the institution by adopting a Silicon Valley-style portfolio approach to funding, tackling the replication crisis, supporting early-career scientists, and leveraging AI to accelerate biomedical research while rebuilding public trust in science.
A summary of the conversation between YC's Harj Taggar and Base's Jesse Pollak about the 'golden age of crypto,' covering the evolution to Fintech 3.0, the technological and regulatory shifts enabling it, and the key opportunities for founders in stablecoins, tokenization, and the intersection of AI and crypto.
Ashley Peacock, author of 'Serverless Apps on Cloudflare,' joins Ricky Robinett to provide a deep dive into Cloudflare's evolution from a security provider to a comprehensive developer platform. They explore its unique global architecture, serverless offerings like Workers and Durable Objects, and its growing suite of AI and data tools, contrasting its developer experience with traditional cloud providers.
Get updates straight to your inbox. No spam, just useful content.