OpenAI's Mark Handley and Greg Steinbrecher detail Multipath Reliable Connection (MRC), a new networking protocol designed to overcome the unique challenges of large-scale AI model training. They explain how moving intelligence to the network's edge creates a resilient, efficient, and simple system that handles constant hardware failures without disrupting massive, synchronized GPU workloads.
Baseten CEO Tuhin Srivastava discusses the explosive growth in AI inference, driven by the adoption of specialized and post-trained open-source models. He covers the strategic importance of owning the software layer on top of compute, navigating the severe GPU supply crunch with a multi-cloud fabric, the evolving landscape of AI workloads, and the operational lessons learned from scaling 30x in one year.
This episode explores the foundations of AI agent memory, drawing parallels with human neuroscience. It also covers the practical impact of AI on data engineering roles, the democratization of AI development through low-code tools, and innovative applications of AI in elementary education to foster critical thinking.
Linda Haviv discusses the evolving AI landscape, arguing that systems thinking is becoming more critical than coding. She highlights how non-linear career paths and domain-specific expertise provide a competitive edge, and explores how the democratization of technology is fueling a new wave of entrepreneurship and content creation for tech professionals.
Linda Haviv discusses the modern AI landscape, emphasizing that non-linear career paths and systems thinking are now more valuable than pure coding skills. She explores how open-source technology, like the Ray framework, is democratizing AI development and closing the gap with proprietary models, and why building a personal brand through content creation is essential for career growth and community building in a rapidly evolving industry.
Gergely Orosz, author of The Pragmatic Engineer, discusses the bizarre trend of 'token maxing' in Big Tech, the evolving role of software engineers in the AI era, and why companies are heavily investing in internal AI infrastructure despite uncertain productivity gains.