Interactive discovery
Follow the connections between themes, people, and ideas across the Tokenless archive in an interactive topic modeling map.
SWE-Marathon introduces a benchmark for long-horizon autonomous software engineering, pushing coding agents from bug fixes to full project ownership. It highlights the critical need for robust, multi-layered verification and anti-cheat mechanisms to prevent reward hacking in tasks spanning hundreds of millions of tokens, revealing that current agents achieve only a 26% success rate.
RL Nabors discusses the significant costs associated with using frontier AI models, covering security, latency, and financial implications. She introduces a framework for right-sizing AI solutions by leveraging smaller, task-specific models and Small Language Models (SLMs). The framework details how to prove task feasibility, establish success criteria with golden datasets, conduct capability evaluations (using tools like Phoenix), and select the most appropriate "Small And Good Enough" (SAGE) model. Nabors further demonstrates how prompt engineering, particularly few-shot prompting, and post-processing can close performance gaps with larger models, while advocating for continuous regression evaluations to maintain performance integrity. The overarching message is to "prototype big, deploy small" to optimize AI deployments.
Vaidas Razgaitis, Senior Research Engineer at Higharc, shares three tactical tips to accelerate the transition of novel AI/ML research into production-ready features. He emphasizes addressing the critical handoff challenge between ML researchers and software engineers through structured documentation (Research Prototype Taxonomy Document), a well-organized monorepo utilizing decoupled microservices, and a systematic approach to code decomposition and PR review. These strategies aim to improve legibility, maintainability, and delivery speed for ML-driven products.
OpenAI's Romain Huet and Alexander Embiricos, joined by Peter Steinberger, outline the explosive progress of Codex at Dev Day 2024. They highlight the shift from manual coding to managing autonomous agents, enabled by rapid model iteration (every 6 weeks), open-source developer tools, and optimizations for cost-effectiveness ($1/M input tokens) and blazing inference speed (750 tokens/sec). The discussion centers on empowering AI engineers, not replacing them, by evolving agent capabilities, fostering an open ecosystem, and addressing future challenges like seamless local/cloud task execution and human attention as the new bottleneck in agent orchestration.
This video tackles the overwhelming choice of agentic AI frameworks by categorizing projects into five types: linear workflows, autonomous multi-agent systems, role-based AI, production orchestration, and rapid prototyping. It details each type with examples and recommends specific frameworks like LangChain, AutoGen, and CrewAI, guiding developers to select the optimal tool based on their system design and real-world needs.
Booking Holdings CEO Glenn Fogel discusses his journey from Priceline's early struggles to leading a global travel giant. He details Booking's strategic adoption of AI for agentic travel planning and customer service, exemplified by Priceline's 'Penny,' and its significant capital investment in technology. Fogel emphasizes continuous innovation over "moats" and shares insights on AI's impact on job displacement, advocating for proactive employee upskilling to navigate the rapidly changing technological landscape.
Sara Bergman presents a practical guide on migrating .NET services to ARM-based architectures to achieve significant energy efficiency, cost savings, and performance per watt. She details the advantages of RISC over CISC, offers real-world examples, and provides a step-by-step .NET migration journey, emphasizing the importance of staying current with .NET, leveraging compilers, and strategically integrating ARM into development and deployment pipelines.
Zipline co-founder Keller Rinaudo Cliffton and Eric Watson discuss how their autonomous logistics system evolved from addressing critical needs in Rwanda to becoming the largest commercial autonomous system globally. They highlight that the drone is only 15% of the solution, emphasizing the deep integration of software, vertical hardware design, advanced safety protocols like compute failover, and extensive testing required. The discussion also covers the immense market potential for autonomous delivery, the impending cost-effectiveness over traditional methods, and the necessary transformation of air traffic control to support a future of pervasive aerial autonomy.
Trisha Gee delivers a compelling talk on Developer Productivity Engineering (DPE) for testing, dissecting common pain points in writing, troubleshooting, and running tests. She advocates for strategic use of IDEs, advanced tooling like build caches and predictive test selection (leveraging ML), and a disciplined approach to test design to overcome these challenges, emphasizing that good tests serve as crucial living documentation.
Chai Discovery's co-founders discuss Chai 2, their new generative AI platform for antibody design. It achieves a nearly 20% hit rate from just 20 computational attempts, a 100-fold improvement over previous methods, signaling a shift from drug discovery to drug engineering.
Sebastian Thrun, co-founder of Google's Moonshot Factory, recounts the early days of X and the Waymo self-driving car project. He shares insights into the unique management philosophy that fostered radical innovation, the ethical responsibilities of technologists, and his optimistic vision for the future of AI.
Douwe Kiela, CEO of Contextual AI, explains the evolution from basic RAG to "RAG 2.0", an end-to-end, trainable system. He argues that this system-level approach, which integrates optimized document parsing, retrieval, reranking, and grounded models, is superior to relying on massive context windows alone and is a fundamental tool for next-generation AI agents.
Push Kohli and Máté Balog from Google DeepMind discuss AlphaDev, an AI agent that uses large language models and evolutionary search to discover novel, more efficient algorithms for fundamental computer science problems, marking a significant step in AI's ability to generate creative and practical solutions.
Anish Agarwal and Raj Agrawal, co-founders of Traversal, discuss how their AI agents automate root cause analysis (RCA) for critical system failures. They detail their agent's architecture, which leverages causal inference and large-scale computation to systematically find the root cause in minutes, and argue that the rise of AI-generated code makes AI-powered debugging an essential capability for modern software engineering.
AI is being used to address critical information gaps in ecology. This summary covers how deep learning models like vision transformers and foundational models for sound are applied to map global forests, monitor deforestation, track species, and analyze bioacoustics to understand ecosystem health and animal communication.
Get updates straight to your inbox. No spam, just useful content.