Tokenless

Deep seek

The State of Frontier Post-Training Recipes | Conversation with Finbarr Timbers

The State of Frontier Post-Training Recipes | Conversation with Finbarr Timbers

This discussion with Finbarr Timbers reviews the evolution of frontier post-training recipes, highlighting the shift from simpler SFT-DPO-RL to complex multi-teacher on-policy distillation (MOPD). It covers the organizational challenges of building models like Olmo, the rise of synthetic data and reasoning-focused RL in DeepSeek, and the complexities of integrating expert teachers, while also exploring open questions on environments, specialized APIs, and career strategies in the rapidly changing AI landscape.

Inside China's AI Labs with Interconnects & SAIL Media

Inside China's AI Labs with Interconnects & SAIL Media

Firsthand reflections from a visit to China’s most prominent AI labs, exploring the human side of the Chinese AI ecosystem, the technical constraints they face from chip supply, and how their research culture compares to the Bay Area.

Why AI Engineers Need to Understand GPU Hardware (with Chris Fregly)

Why AI Engineers Need to Understand GPU Hardware (with Chris Fregly)

Chris Fregly, author of 'AI Systems Performance Engineering', explains that true performance gains in AI come not from raw compute but from a deep, holistic understanding of the entire hardware and software stack. He emphasizes that memory bandwidth is the most critical GPU metric and introduces the concept of 'mechanical sympathy'—the co-design of hardware, software, and algorithms—as the key to unlocking efficiency and overcoming modern bottlenecks.

OpenAI, Oracle & AMD shake up AI

OpenAI, Oracle & AMD shake up AI

The panel discusses the shifting AI hardware landscape as Oracle and OpenAI bet on AMD, challenging Nvidia's dominance. They also analyze a US government report on the risks of the DeepSeek model, debate the viability of Reflection AI's new $2B open-source venture, and dissect the story of a VC fund replacing analysts with AI agents.

Ethics in AI: Biases & Responsibilities • Michelle Frost & Hannes Lowette

Ethics in AI: Biases & Responsibilities • Michelle Frost & Hannes Lowette

AI advocate Michelle Frost and consultant Hannes Lowette discuss the complex ethical landscape of AI development. They cover the value alignment problem, balancing competing values like accuracy versus fairness, the impact of recent US regulatory changes, and market disruptions from innovations like Deep Seek, ultimately calling for individual and corporate accountability to develop AI responsibly.