Interactive discovery
Follow the connections between themes, people, and ideas across the Tokenless archive in an interactive topic modeling map.
SWE-Marathon introduces a benchmark for long-horizon autonomous software engineering, pushing coding agents from bug fixes to full project ownership. It highlights the critical need for robust, multi-layered verification and anti-cheat mechanisms to prevent reward hacking in tasks spanning hundreds of millions of tokens, revealing that current agents achieve only a 26% success rate.
RL Nabors discusses the significant costs associated with using frontier AI models, covering security, latency, and financial implications. She introduces a framework for right-sizing AI solutions by leveraging smaller, task-specific models and Small Language Models (SLMs). The framework details how to prove task feasibility, establish success criteria with golden datasets, conduct capability evaluations (using tools like Phoenix), and select the most appropriate "Small And Good Enough" (SAGE) model. Nabors further demonstrates how prompt engineering, particularly few-shot prompting, and post-processing can close performance gaps with larger models, while advocating for continuous regression evaluations to maintain performance integrity. The overarching message is to "prototype big, deploy small" to optimize AI deployments.
Vaidas Razgaitis, Senior Research Engineer at Higharc, shares three tactical tips to accelerate the transition of novel AI/ML research into production-ready features. He emphasizes addressing the critical handoff challenge between ML researchers and software engineers through structured documentation (Research Prototype Taxonomy Document), a well-organized monorepo utilizing decoupled microservices, and a systematic approach to code decomposition and PR review. These strategies aim to improve legibility, maintainability, and delivery speed for ML-driven products.
This conversation explores the shift in enterprise software as AI agents become primary users, moving towards 'headless' architectures where data and logic, rather than UIs, hold key value. It delves into the enduring stickiness of systems like SAP, driven by deep business process codification, and highlights that 'exception handling' is central to enterprise complexity. The discussion identifies new startup opportunities arising from AI, focusing on enhancing existing systems and bridging organizational functions rather than direct competition.
Benjamin Todd provides an updated career strategy for the AI era, explaining why 'follow your passion' is flawed and what truly builds fulfillment. He details the ABZ framework for planning under deep uncertainty and the 'moving bottleneck' concept to stay valuable as AI advances. The discussion highlights that a human-level digital worker quickly becomes superhuman and maps critical AI risks including power-seeking AI, extreme power concentration, and engineered pandemics, emphasizing that individual careers can be a powerful lever for good in these transformative times.
The Microsoft Research India Academic Research Summit 2026 session on "Inclusive AI" explored critical challenges in developing AI that serves diverse linguistic and cultural contexts. Speakers Niloy Ganguly, Danish Pruthi, Sunayana Sitaram, Anoop Kunchukuttan, and Ashutosh Modi addressed data gaps, model biases, and evaluation shortcomings, emphasizing the need for equitable and culturally relevant AI. Key themes included the use of synthetic data for low-resource languages, the impact of tokenization on model performance, geographical disparities in generative AI, and the application of AI for social good in legal and accessibility domains. The discussions underscored the importance of community involvement, open data, and designing AI for multilinguality from the outset, rather than as an afterthought.
Zipline co-founder Keller Rinaudo Cliffton and Eric Watson discuss how their autonomous logistics system evolved from addressing critical needs in Rwanda to becoming the largest commercial autonomous system globally. They highlight that the drone is only 15% of the solution, emphasizing the deep integration of software, vertical hardware design, advanced safety protocols like compute failover, and extensive testing required. The discussion also covers the immense market potential for autonomous delivery, the impending cost-effectiveness over traditional methods, and the necessary transformation of air traffic control to support a future of pervasive aerial autonomy.
Trisha Gee delivers a compelling talk on Developer Productivity Engineering (DPE) for testing, dissecting common pain points in writing, troubleshooting, and running tests. She advocates for strategic use of IDEs, advanced tooling like build caches and predictive test selection (leveraging ML), and a disciplined approach to test design to overcome these challenges, emphasizing that good tests serve as crucial living documentation.
This episode delves into Q-Day, the anticipated future when quantum computers can break public key cryptography, and the U.S. Executive Order accelerating the transition to post-quantum cryptography. Experts discuss why Q-Day is a gradual process rather than a sudden event, the critical importance of "crypto-agility" as a long-term strategy, and the necessity for organizations to begin immediate discovery and planning to secure data against "collect now, decrypt later" threats. The discussion also touches upon the broader, transformative benefits of quantum computing beyond just security.
Jerry from LlamaIndex explains why naive Retrieval-Augmented Generation (RAG) fails in production and dives deep into advanced data quality techniques—from parsing complex documents and hierarchical indexing to chunking best practices—required to build robust, high-quality LLM applications.
Dell's Shirish Gupta and Ish Shah discuss the complexities developers face in leveraging on-device accelerators like NPUs and GPUs. They introduce Dell ProAI Studio, a solution designed to abstract away hardware-specific toolchains, enabling developers to easily run AI workloads locally for benefits like speed, cost, security, and offline capability.
Erik Torenberg, Patrick Hsu (Arc Institute), and Jorge Conde (a16z) discuss Arc's moonshot to create 'virtual cells' using foundation models to simulate biology. They cover why science is slow, how AI can accelerate drug discovery by predicting cellular perturbations, and the remaining bottlenecks in clinical trials and capital intensity that the biotech industry faces.
Ethan Smith, CEO of Graphite, explains Answer Engine Optimization (AEO), the new frontier of getting your product featured in answers from LLMs like ChatGPT. He shares his playbook for ranking in these new systems, revealing why AEO traffic can convert 6x better than traditional search and how even early-stage startups can achieve immediate wins by focusing on landing pages, YouTube videos, and authentic Reddit engagement.
Sergey Levine, co-founder of Physical Intelligence, outlines the path to general-purpose robots, predicting a 'self-improvement flywheel' could lead to fully autonomous household robots by 2030. He discusses the architecture of vision-language-action models, the critical role of embodiment in solving the data problem, and how robotics will scale faster than self-driving cars.
Hudson Buzby from JFrog discusses the critical security, governance, and legal challenges enterprises face when adopting open-source AI models. He highlights the risks lurking in repositories like Hugging Face and argues for a centralized, curated AI gateway as the essential framework for enabling safe, scalable, and cost-effective AI development.
Get updates straight to your inbox. No spam, just useful content.