A technical guide on migrating ML experiments from Neptune to Weights & Biases, covering the migration script, API-level code changes, and best practices for organizing projects and analyzing results in the W&B platform before the Neptune sunset.
W&B Models is the system of record for the entire model development lifecycle. This guide explores how to monitor training, tune hyperparameters, track artifacts and lineage for reproducibility, and automate MLOps workflows like evaluation and deployment using a central platform.
An expert overview of post-training techniques for language models, covering the entire workflow from data generation and curation to advanced algorithms like Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and Reinforcement Learning (RL), along with practical advice on evaluation and iteration.
Kwangjun Ahn from Microsoft Research provides a technical overview of orthonormal optimizers (like Muon and Dion2), a new class of algorithms for large-scale AI model training that are emerging as powerful successors to AdamW. The talk covers their theoretical foundations, empirical benefits, distributed implementation strategies, and practical guidelines for integration into modern training pipelines.
Experts on the Mixture of Experts podcast analyze Perplexity Computer's pivot to agent orchestration and debate its closed-system approach versus open alternatives like OpenClaw. They also discuss Anthropic's new memory import feature for Claude, questioning if memory is still a competitive moat, and explore NullClaw, a minimalist agent framework that sparks a conversation about the future of edge-based agent swarms. Finally, they tackle the controversial debut of Tilly Norwood, the world's first AI actor, and debate the implications for the entertainment industry and the personification of AI.
Cursor's team discusses their latest Cloud Agents launch, which gives agents full cloud VMs to test changes, record demo videos, and provide remote access. We explore parallel model swarms, bug reproduction workflows, and the future of agentic coding where throughput and new bottlenecks in review and CI/CD take center stage.
Ajay Chankramath and Nic Cheneweth discuss the critical elements of effective platform engineering, emphasizing a product mindset, the foundational role of control planes and API-first design, the common pitfalls of implementing Backstage, and the emerging impact of AI and agents on the platform landscape.
Experts Sam Newman, Jacqui Read, and Simon Rohrer explore the nuances of software design, its intersection with architecture, and the critical role of communication in scaling technical clarity. The discussion covers practical advice on implementing Architectural Decision Records (ADRs), the evolving role of the architect as a facilitator, and strategies for creating agile enterprise architectures.
Docker educators Bret Fisher and Elton Stoneman discuss the second edition of Stoneman's book, "Learn Docker in a Month of Lunches". They explore why Docker fundamentals remain crucial in a Kubernetes-dominated world, the evolution of the container ecosystem over the past five years, and the key skills that differentiate a Docker expert from a beginner, such as multi-platform builds, security, and configuration management.
Kiriti Badam from OpenAI introduces 'co-engineering,' a new paradigm where humans and AI agents collaborate as teammates in the software development lifecycle. He outlines key principles for effectively integrating AI agents into enterprise workflows, focusing on context management, security, and iterative improvement.
AI models show remarkable progress on benchmarks, yet a field study with experienced developers revealed no productivity gains. This summary explores the disconnect between lab results and real-world impact, examining the causal relationship between compute and AI capabilities, the nuances of the developer productivity study, and future directions for measuring what AI can truly do.
Prashanth HN explores the powerful synergy between event-driven Agentic AI and Serverless architecture. Learn how AWS services like Lambda, Step Functions, and Bedrock provide the essential building blocks for creating sophisticated, scalable, and cost-effective AI agents, with practical examples of Agentic RAG, swarms, and orchestration patterns.
Chip Huyen provides a deep dive into the evolving landscape of AI-powered coding. The talk covers the different interfaces for AI coding tools, introduces new metrics like "interruption rate" to measure productivity, and outlines a framework for the levels of coding automation. Huyen argues that the engineer's role is shifting from writing code to architecting systems and reviewing AI-generated output, emphasizing the rise of spec-driven development and the critical importance of system thinking.
Zevi Arnovitz, a non-technical Product Manager at Meta, shares his complete workflow for building and shipping sophisticated applications using AI tools like Cursor. He details a structured, multi-step process that leverages different AI models for specific tasks, including a novel "peer review" technique where models critique each other's code.
![Why Every Brain Metaphor in History Has Been Wrong [SPECIAL EDITION]](https://img.youtube.com/vi/pO0WZsN8Oiw/maxresdefault.jpg)
An exploration of scientific simplification, questioning the metaphors we use to understand the brain and intelligence. This summary delves into the tension between creating useful models and mistaking them for reality, featuring insights on the mind-as-software debate, the limits of prediction versus understanding, and the philosophical underpinnings of our quest for AGI.
Get updates straight to your inbox. No spam, just useful content.