Tokenless

Tokenless

a16z Goes Global: Why American Tech Must Lead the World

Interactive discovery

Explore the topic map

Follow the connections between themes, people, and ideas across the Tokenless archive in an interactive topic modeling map.

Open the map Browse posts

Machine Learning

View All
Frontier results, on device - RL Nabors, Arize

Frontier results, on device - RL Nabors, Arize

RL Nabors discusses the significant costs associated with using frontier AI models, covering security, latency, and financial implications. She introduces a framework for right-sizing AI solutions by leveraging smaller, task-specific models and Small Language Models (SLMs). The framework details how to prove task feasibility, establish success criteria with golden datasets, conduct capability evaluations (using tools like Phoenix), and select the most appropriate "Small And Good Enough" (SAGE) model. Nabors further demonstrates how prompt engineering, particularly few-shot prompting, and post-processing can close performance gaps with larger models, while advocating for continuous regression evaluations to maintain performance integrity. The overarching message is to "prototype big, deploy small" to optimize AI deployments.

Research to Reality: Bringing Frontier ML Research to Production - Vaidas Razgaitis, Higharc

Research to Reality: Bringing Frontier ML Research to Production - Vaidas Razgaitis, Higharc

Vaidas Razgaitis, Senior Research Engineer at Higharc, shares three tactical tips to accelerate the transition of novel AI/ML research into production-ready features. He emphasizes addressing the critical handoff challenge between ML researchers and software engineers through structured documentation (Research Prototype Taxonomy Document), a well-organized monorepo utilizing decoupled microservices, and a systematic approach to code decomposition and PR review. These strategies aim to improve legibility, maintainability, and delivery speed for ML-driven products.

Uncertainty-Guided Data Augmentation for Engineers | Deep Dive - Yongmin Kwon

Uncertainty-Guided Data Augmentation for Engineers | Deep Dive - Yongmin Kwon

This session details a data-efficient method for training engineering surrogate models by using uncertainty quantification (UQ) to guide geometric data augmentation. Instead of random deformations, the approach lets the deep ensemble model identify its own knowledge gaps (epistemic uncertainty), then uses Free-Form Deformation (FFD) to generate new shapes specifically in those uncertain regions. This ensures every expensive simulation run yields maximally informative data, significantly improving model accuracy for a fixed computational budget across domains like structural mechanics and aerodynamics.

Artificial Intelligence

View All
a16z Goes Global: Why American Tech Must Lead the World

a16z Goes Global: Why American Tech Must Lead the World

This discussion explores a16z's expanding international strategy, emphasizing technology's pivotal role in economic growth and national security. The panel delves into why America's tech leadership is crucial globally, how AI is redefining government-private sector relationships, and the drive for countries to adopt frontier technologies while building local innovation ecosystems. Key topics include AI infrastructure, cybersecurity, defense tech, global startup expansion, and the elements of enduring tech ecosystems, highlighting trusted partnerships and the importance of Western technology.

GPT-5.6 Sol, FIFA AI & Wall Street’s AI nerves

GPT-5.6 Sol, FIFA AI & Wall Street’s AI nerves

OpenAI's new GPT-5.6 Sol model sparks debate on AI safety and release strategies, while Wall Street expresses growing skepticism over the long-term economics of frontier AI models. The discussion also touches on AI's impact on the FIFA World Cup and a thought-provoking paper comparing LLM anthropomorphism to Age of Empires II "goats."

The Prompt Is Still a Punch Card - Ted Johnson, JoinIn AI

The Prompt Is Still a Punch Card - Ted Johnson, JoinIn AI

Ted Johnson argues that current AI interfaces, particularly prompting, operate on an outdated "batch processing" protocol akin to punch cards. Despite advanced LLM capabilities, this interface design forces humans to adapt to machines, hindering natural interaction. He advocates for a shift towards human-compatible interfaces where AI actively participates in real-time conversation, leveraging its intelligence to remove user burdens and amplify human potential.

Technology

View All
Are Your Tests Slowing You Down? • Trisha Gee • GOTO 2025

Are Your Tests Slowing You Down? • Trisha Gee • GOTO 2025

Trisha Gee delivers a compelling talk on Developer Productivity Engineering (DPE) for testing, dissecting common pain points in writing, troubleshooting, and running tests. She advocates for strategic use of IDEs, advanced tooling like build caches and predictive test selection (leveraging ML), and a disciplined approach to test design to overcome these challenges, emphasizing that good tests serve as crucial living documentation.

The new post-quantum cryptography executive order. Plus: What is Q-Day, really?

The new post-quantum cryptography executive order. Plus: What is Q-Day, really?

This episode delves into Q-Day, the anticipated future when quantum computers can break public key cryptography, and the U.S. Executive Order accelerating the transition to post-quantum cryptography. Experts discuss why Q-Day is a gradual process rather than a sudden event, the critical importance of "crypto-agility" as a long-term strategy, and the necessity for organizations to begin immediate discovery and planning to secure data against "collect now, decrypt later" threats. The discussion also touches upon the broader, transformative benefits of quantum computing beyond just security.

Plenary Talk 3​: Challenges and research opportunities for global hyperscale services

Plenary Talk 3​: Challenges and research opportunities for global hyperscale services

Jim Kleewein's talk outlines the immense challenges and critical research opportunities in building and operating global hyperscale services like Microsoft 365 and Azure. He emphasizes that at this scale, traditional approaches fail, necessitating a "new golden age of applied research" across areas like continuous availability, data management, security, and sustainability. Kleewein also discusses AI's powerful but limited role, stressing the ongoing need for human expertise, and highlights the ethical imperative to prevent failures that can have life-or-death consequences.

Recent Post

AI Code Generation: Wins, Fails and the Future

AI Code Generation: Wins, Fails and the Future

A panel of experts discusses the future of AI in software engineering, focusing on the "barbell effect" where AI excels at hyper-complex tasks but fails at simple ones. The conversation explores whether performance is driven by the model or the agent orchestration, the evolving role of the engineer as an architect, and the significant challenges open-source tools face against vertically integrated proprietary systems, particularly the high cost of inference.

Beyond Sonic Pi: Tau5 & the Art of Coding with AI • Sam Aaron • GOTO 2025

Beyond Sonic Pi: Tau5 & the Art of Coding with AI • Sam Aaron • GOTO 2025

Sam Aaron, creator of Sonic Pi, discusses the journey from teaching children to code with music to building the next generation of live coding environments. He details the limitations of Sonic Pi (security, deployment) that led to Tau5, a new system built on Elixir and the BEAM. Tau5 is designed to be web-based, secure via a sandboxed Lua environment, and collaborative. A key focus is the integration of AI as a creative partner, using sophisticated tooling to allow AI agents to safely improvise and interact with the system.

What are we scaling?

What are we scaling?

A critical analysis of AI progress, arguing that short AGI timelines are unlikely given the current reliance on pre-baking skills via reinforcement learning. The author contends that true AGI requires on-the-job, continual learning—a capability current models lack. The modest economic impact of AI is presented not as a diffusion lag but as direct evidence of this capability gap. The future of AI will be a gradual, competitive race to solve continual learning, not a sudden takeoff.

Developer Experience in the Age of AI Coding Agents – Max Kanat Alexander, Capitol One

Developer Experience in the Age of AI Coding Agents – Max Kanat Alexander, Capitol One

Max Kanat-Alexander explores the rapid changes in software engineering driven by AI and identifies 'no-regrets investments' that will benefit development teams regardless of the future. He argues that by focusing on foundational developer experience principles—such as standardizing tools, improving validation, structuring code for testability, and refining the code review process—organizations can create a virtuous cycle of productivity for both human developers and their AI agent counterparts.

Continual System Prompt Learning for Code Agents – Aparna Dhinakaran, Arize

Continual System Prompt Learning for Code Agents – Aparna Dhinakaran, Arize

The talk by Aparna Dhinakaran introduces "system prompt learning" as an efficient alternative to traditional Reinforcement Learning for improving large language model-based coding agents. By leveraging LLM-as-a-judge evaluations to generate English feedback and explanations for code failures, agents can automatically refine their system prompts and rules. This method, demonstrated on Claude and Klein, significantly boosts performance on benchmarks like SWEBench with minimal data, highlighting the critical role of high-quality evaluation prompts.

Making Codebases Agent Ready – Eno Reyes, Factory AI

Making Codebases Agent Ready – Eno Reyes, Factory AI

The effectiveness of AI coding agents is not limited by model quality, but by "Agent Readiness"—the state of your development environment. This talk explains why agents fail on codebases with flaky tests, low validation, and tribal knowledge. It introduces a framework for improving your environment's readiness through rigorous verification, automated validation, and a shift to specification-driven development, arguing this is the key to unlocking 5-7x productivity gains and enabling true software engineering autonomy.

← PreviousNext →

Stay In The Loop! Subscribe to Our Newsletter.

Get updates straight to your inbox. No spam, just useful content.