Robin Bordoli of Weights & Biases explores AI's exponential growth, from past achievements to the current agentic landscape. He discusses the rise of reinforcement learning, the challenge of productionizing reliable agents, and highlights how foundational issues in AI development persist even as model capabilities soar.
A summary of the keynote by Lukas Biewald (Weights & Biases) and Camille Fournier (CoreWeave) at Fully Connected London 2025. They discuss recent product updates for W&B Models and Weave, the synergy behind the CoreWeave acquisition, and a deep dive into building and automating an autonomous software engineer agent.
Epoch AI researchers discuss the AI landscape, arguing against a bubble due to strong enterprise spending and profitability. They forecast significant economic shifts, including a potential 30% GDP growth with advanced AI and the automation of 10% of current jobs this decade. The summary covers the unlikelihood of a software-only singularity, the reality of data center buildouts (with Anthropic surprisingly in the lead), and why energy 'bottlenecks' are economic trade-offs, not hard limits. Also explored are timelines for AI solving major mathematical problems and why robotics remains primarily a hardware challenge.
![AI That Can Change Its Mind? (New Architecture) [w/ Sakana CTO]](https://img.youtube.com/vi/DtePicx_kFY/maxresdefault.jpg)
Llion Jones, a co-inventor of the Transformer, and his colleague Luke Darlow from Sakana AI argue that the AI industry is trapped in a local minimum by the Transformer's success. They discuss the architecture's fundamental limitations using the 'spiral problem' analogy and introduce their new, biology-inspired Continuous Thought Machine (CTM), an architecture designed for more human-like, sequential reasoning and adaptive computation.
Jeff Huber, CEO of Chroma, discusses "context rot," the degradation of AI performance in large context windows, and outlines a new vision for retrieval infrastructure. He covers the evolution of search, the importance of a two-stage recall-then-precision pipeline, and the challenges of agentic memory, advocating for a shift from AI "alchemy" to reliable engineering.
Zhang Yuxuan from Z.ai details the technical roadmap behind the GLM-4.6 model series, which has achieved top performance on the LMSYS Chatbot Arena. The summary covers their 15T token data recipe, the SLIME framework for efficient agent RL, key lessons in single-stage long-context training, and the architecture of the multimodal GLM-4.5V model.