Interactive discovery
Follow the connections between themes, people, and ideas across the Tokenless archive in an interactive topic modeling map.
SWE-Marathon introduces a benchmark for long-horizon autonomous software engineering, pushing coding agents from bug fixes to full project ownership. It highlights the critical need for robust, multi-layered verification and anti-cheat mechanisms to prevent reward hacking in tasks spanning hundreds of millions of tokens, revealing that current agents achieve only a 26% success rate.
RL Nabors discusses the significant costs associated with using frontier AI models, covering security, latency, and financial implications. She introduces a framework for right-sizing AI solutions by leveraging smaller, task-specific models and Small Language Models (SLMs). The framework details how to prove task feasibility, establish success criteria with golden datasets, conduct capability evaluations (using tools like Phoenix), and select the most appropriate "Small And Good Enough" (SAGE) model. Nabors further demonstrates how prompt engineering, particularly few-shot prompting, and post-processing can close performance gaps with larger models, while advocating for continuous regression evaluations to maintain performance integrity. The overarching message is to "prototype big, deploy small" to optimize AI deployments.
Vaidas Razgaitis, Senior Research Engineer at Higharc, shares three tactical tips to accelerate the transition of novel AI/ML research into production-ready features. He emphasizes addressing the critical handoff challenge between ML researchers and software engineers through structured documentation (Research Prototype Taxonomy Document), a well-organized monorepo utilizing decoupled microservices, and a systematic approach to code decomposition and PR review. These strategies aim to improve legibility, maintainability, and delivery speed for ML-driven products.
Modal CTO Akshat Bubna discusses the company's shift from developer to agent experience, highlighting why traditional cloud infrastructure fails for bursty AI workloads. He details Modal's primitives like elastic inference with GPU snapshotting and speculative decoding, agent sandboxes for RL rollouts, multi-node training with RDMA, and a "supercloud" strategy across 17 providers. The conversation also covers the importance of observability, hard guardrails for production agents, and AI's role in making infrastructure exciting again.
An in-depth look into GPT Live, the next generation of full-duplex voice models in ChatGPT, designed for natural, continuous interaction. It highlights breakthroughs in concurrent processing, intelligent delegation to advanced models like GPT 5.5, real-time semantic translation, and proactive language coaching, aiming to transform AI interactions into fluid, intelligent conversations akin to human dialogue.
Theo Browne's keynote from AIEWF2026 urges software engineers to fundamentally change product development in response to rapidly evolving AI models (Sonnet 3.5 to Mythos). He advocates for rejecting legacy mental models and tools (skeuomorphism), embracing a new "Markdown tier" for projects, and thinking "wider" instead of just "deeper" by building extensible platforms that can challenge industry giants. The core message is to be more ambitious, as AI has drastically lowered the barrier to entry for complex, broad-reaching solutions.
Zipline co-founder Keller Rinaudo Cliffton and Eric Watson discuss how their autonomous logistics system evolved from addressing critical needs in Rwanda to becoming the largest commercial autonomous system globally. They highlight that the drone is only 15% of the solution, emphasizing the deep integration of software, vertical hardware design, advanced safety protocols like compute failover, and extensive testing required. The discussion also covers the immense market potential for autonomous delivery, the impending cost-effectiveness over traditional methods, and the necessary transformation of air traffic control to support a future of pervasive aerial autonomy.
Trisha Gee delivers a compelling talk on Developer Productivity Engineering (DPE) for testing, dissecting common pain points in writing, troubleshooting, and running tests. She advocates for strategic use of IDEs, advanced tooling like build caches and predictive test selection (leveraging ML), and a disciplined approach to test design to overcome these challenges, emphasizing that good tests serve as crucial living documentation.
This episode delves into Q-Day, the anticipated future when quantum computers can break public key cryptography, and the U.S. Executive Order accelerating the transition to post-quantum cryptography. Experts discuss why Q-Day is a gradual process rather than a sudden event, the critical importance of "crypto-agility" as a long-term strategy, and the necessity for organizations to begin immediate discovery and planning to secure data against "collect now, decrypt later" threats. The discussion also touches upon the broader, transformative benefits of quantum computing beyond just security.
Sriram Krishnan, Senior White House Policy Advisor on AI, outlines the America AI Action Plan, a strategy designed to ensure U.S. dominance in artificial intelligence. He discusses the three core pillars of the plan—infrastructure, innovation, and global standards—while also exploring the geopolitical race with China, the critical role of open-source models, and the need for America to own the full AI stack, from GPUs to applications.
A technical deep dive into Apple's Private Cloud Compute (PCC), exploring its novel architecture for running sensitive AI workloads with cryptographic privacy guarantees. The talk covers the core requirements, key components like remote attestation and transparency logs, and how these concepts can be applied by developers today.
A security analysis of YC AI agents reveals that the most critical vulnerabilities are not in the LLM itself, but in the surrounding infrastructure. This breakdown of a red teaming exercise, where 7 out of 16 agents were compromised, highlights three common and severe security flaws: cross-user data access (IDOR), remote code execution via insecure sandboxes, and server-side request forgery (SSRF).
OpenAI's Head of Education, Leah Belsky, and students Yabsera and Alaap discuss how AI, particularly ChatGPT and its new Study Mode, is transforming education. They cover global adoption, the shift from policing AI to integrating it, its role as a personal tutor for building confidence and skills, and the evolving nature of learning, work, and critical thinking in the age of AI.
Fouad Matin from OpenAI's Agent Robustness and Control team discusses the critical safety and security challenges of code-executing AI agents. He explores the shift from models that *can* execute code to defining what they *should* be allowed to do, presenting practical safeguards like sandboxing, network control, and human review, drawing from OpenAI's experience building Code Interpreter and the open-source Code Interpreter CLI.
Exploring the collision of AI and the attention economy, this discussion unpacks the rise of AI-generated 'slop', the retreat to private group chats, and the shifting economics of media in an age where algorithms optimize for clicks over genuine human interest.
Get updates straight to your inbox. No spam, just useful content.