Tokenless

Tokenless

Your AI Agent Starts Every Session Like a New Hire - Killian Carlsen-Phelan, Sonar

Interactive discovery

Explore the topic map

Follow the connections between themes, people, and ideas across the Tokenless archive in an interactive topic modeling map.

Open the map Browse posts

Machine Learning

View All
Judge a Transaction by the Company It Keeps — Somya Rai & MD Sharique, EXL

Judge a Transaction by the Company It Keeps — Somya Rai & MD Sharique, EXL

EXL developed an advanced fraud detection system that augments XGBoost with Graph Neural Network (GNN) embeddings. Traditional tabular models struggle to capture fraud signals residing in transaction neighborhoods. The system's innovative design includes meticulous sampling strategies, disjoint monthly graph construction for leakage control, and a GraphSAGE architecture that aggregates mean, max, and standard deviation of neighbor features to detect subtle fraud patterns. Emphasizing explainability for regulatory compliance and analyst trust, it also features a highly optimized serving architecture achieving 3ms P99 latency, pivoting to edge prediction to reduce cache footprint from 60GB to 2-3GB. This led to a 27-33% relative lift in true positive rates and a projected $65 million incremental fraud capture.

From 15% to 90% GPU Utilization: Fix the Data Pipeline, Not the Model

From 15% to 90% GPU Utilization: Fix the Data Pipeline, Not the Model

Tarun Sunkaraneni from Amazon AGI shows how a multimodal SFT pipeline that spent about 85% of its time waiting on data was brought to roughly 90% GPU utilization. He walks through concurrency with asyncio and Ray actors, prefetching, zero-copy transfer via Ray's object store, and a network-card bottleneck that appears only at scale, and argues that the hardest part of training throughput is often keeping GPUs fed rather than optimizing the model.

Small Models, Big Results: Training a Finance Agent for Under $500 — Charles Dickens, Snorkel AI

Small Models, Big Results: Training a Finance Agent for Under $500 — Charles Dickens, Snorkel AI

Snorkel AI and UC Berkeley's Sky Computing Lab show that a 4B Qwen3 model, trained with reinforcement learning for under $500 using the rLLM framework, beats its 235B sibling on expert-validated financial question answering built from SEC 10-K filings. The talk covers the FinQA dataset construction and verification, common failure modes of frontier models, transfer to multi-table and general tool-use tasks, and ablations showing that simple data and binary rewards outperform more elaborate setups, since the real bottleneck is disciplined tool use rather than reasoning depth.

Artificial Intelligence

View All
Voice AI Where One Wrong Question Breaks the Rules - Shiv Indap, Upstart & Brooke Hopkins, Coval

Voice AI Where One Wrong Question Breaks the Rules - Shiv Indap, Upstart & Brooke Hopkins, Coval

Shiv Indap of Upstart and Brooke Hopkins of Coval walk through automating loan verification calls in a heavily regulated lending environment. They cover the compliance traps that shape the agent's behavior, moving human review beyond a Google Sheet, and raising LLM judge agreement with human reviewers from 33% to 92%. The talk then lays out a continuous loop of live monitoring, human review queues, simulation-based testing of fixes, and self-healing agents, with humans signing off on every change.

Building ChatGPT for Finance — Joseph Kim, OpenAI's Head of Financial Services

Building ChatGPT for Finance — Joseph Kim, OpenAI's Head of Financial Services

Joseph Kim of OpenAI discusses building ChatGPT for Financial Services on a general-purpose model: upstream financial reasoning training, bundling market data after MCP reliability tests, plugin primitives startups can reuse, human-in-the-loop review, training judgment and taste via reward models, and the difficulty of building financial evals.

How to Decide What Your AI Agent Should Remember - Wojciech Pluta, Oracle

How to Decide What Your AI Agent Should Remember - Wojciech Pluta, Oracle

Wojciech Pluta, head of technical marketing for Oracle AI Database, argues that RAG gives agents a read path while memory gives them a write path, and that the write path is where business value lives. He explains memory promotion, a pipeline that admits, rejects, or escalates candidate memories, and demonstrates it with a mortgage agent that remembers preferences across sessions while refusing unsafe rules. The talk also covers short-term, long-term, and shared memory, why databases are a strong storage layer, and the context card that keeps prompts lean.

Technology

View All
Why Founders Are Betting Big on Factories, Mines, and Energy

Why Founders Are Betting Big on Factories, Mines, and Energy

Erin Price-Wright and Connor Love unpack the AD50 and the rebuilding of America's industrial base, covering how defense demand is financing manufacturing capacity for commercial markets, how AI is reshaping factory economics, how a new generation of founders applies lessons from SpaceX, Tesla, Anduril, and Palantir to mining, energy, and manufacturing, and why private capital is now willing to fund physical infrastructure before government demand is guaranteed.

Mark Cuban’s Plan to Make Healthcare Affordable

Mark Cuban’s Plan to Make Healthcare Affordable

Mark Cuban and Julie Yoo discuss how transparency, direct contracting, and AI could reshape healthcare economics, from Cost Plus Drugs and modular pod manufacturing to personalized medicine, the future of physicians, and advice for founders who want to use AI to learn rather than to stop thinking.

Exploits Now Beat Patches: Open Source Security in the AI Era - Patrick Smyth, Chainguard

Exploits Now Beat Patches: Open Source Security in the AI Era - Patrick Smyth, Chainguard

Patrick Smyth of Chainguard examines how frontier AI has compressed the time between vulnerability disclosure and exploitation, leaving 30-day remediation cycles obsolete. The talk covers AI-assisted attacks, waves of supply chain malware, four attack surfaces spanning malware, known CVEs, zero days, and side doors like CI/CD, developer laptops, and agent skills, and practical defenses including cooldown periods, faster CVE remediation, and signing artifacts with SLSA and Sigstore.

Recent Post

Why the Best AI Stories Aren't About AI (with Steve Mock)

Why the Best AI Stories Aren't About AI (with Steve Mock)

Steve Mock, investor and entrepreneur, discusses aisavedme.org, a platform born from his father's question, "How does one use AI?". The site gathers real-world stories of AI's positive impact, revealing surprising human outcomes in healthcare, education, and personal fulfillment, often less about technology and more about connection. He also shares his unique no-code journey in building the site and his venture capital insights into the "data flywheel" and "vertical AI" as key to successful investments.

Anthropic's Katelyn Lesse & Angela Jiang: Building an Ecosystem, not a Walled Garden

Anthropic's Katelyn Lesse & Angela Jiang: Building an Ecosystem, not a Walled Garden

Katelyn Lesse and Angela Jiang, leaders of Anthropic's developer platform, outline their strategy built on a "three-layer cake": knowledge, execution, and coordination. They emphasize moving towards advanced "strategies" or meta-harnesses that assign distinct jobs to tokens, fostering a robust and open AI ecosystem. The discussion covers empowering builders, setting industry standards, and Anthropic's nuanced approach to an open platform versus a walled garden, focusing on architectural soundness over infrastructure ownership.

Why a Nation Can't Outsource Its Frontier AI - Alistair Pullen (Cosine AI)

Why a Nation Can't Outsource Its Frontier AI - Alistair Pullen (Cosine AI)

Alistair Pullen, CEO of Cosine, discusses the UK's sovereign AI initiative, born from US export controls. He outlines Cosine's unique economic model, competing with "millions" against "billions" by licensing models instead of hosting inference. Pullen delves into why open models lag frontier systems, emphasizing active parameters and post-training data. He explains Cosine's innovative approach to "slop" through process-based RL and credit attribution, advocating for runtime proof in code review. The conversation covers their hierarchical "Swarm" sub-agent system, the challenges of memory, and advanced synthetic data generation, concluding on the geopolitical impact of export controls as an unexpected catalyst for UK AI.

The AI Memory Problem: Why Long Context Isn’t Enough — Dan Biderman, Engram Co-founder & CEO

The AI Memory Problem: Why Long Context Isn’t Enough — Dan Biderman, Engram Co-founder & CEO

Engram co-founder Dan Biderman discusses building AI that learns from users, critiquing long context, RAG, and compaction's limitations. He introduces Engram's approach of compressing knowledge into "cartridges" and model weights via continual learning and gradient-based updates, aiming for "intuition" over retrieval. The vision extends to personal, "Tamagotchi" AI models and addresses the critical need for token efficiency and "doing more with less" in both enterprise and personal AI.

Stop Evaluating Models Like It's the 50s - Alejandro Vidal, Mindmakers

Stop Evaluating Models Like It's the 50s - Alejandro Vidal, Mindmakers

This talk introduces the transformative potential of Item Response Theory (IRT), a psychometric model, for evaluating AI models. It addresses the limitations of current evaluation methods by demonstrating how IRT can precisely measure model intelligence, audit and optimize benchmarks, detect data leakage, implement adaptive testing, identify item bias, and even fingerprint models based on their error patterns, opening new avenues for understanding and improving LLM capabilities.

From fork() to Fleet: Designing an Agent Sandbox Cloud — Abhishek Bhardwaj, OpenAI

From fork() to Fleet: Designing an Agent Sandbox Cloud — Abhishek Bhardwaj, OpenAI

This talk by Abhishek Bhardwaj from OpenAI details the architectural considerations for building secure and scalable AI agent sandboxes in the cloud. It explores runtime isolation technologies (from basic process execution to containers, GVisor, and microVMs), emphasizing the superior security of hardware-virtualized microVMs. The speaker then highlights the critical need for persistent storage, outlining explicit (copy-on-write snapshots) and always-on (tiered block storage) solutions as the next major unlock for agent capabilities. Finally, it touches on orchestration challenges for fleet-level management, including low-latency sandbox creation and snapshot-driven scheduling.

← PreviousNext →

Stay In The Loop! Subscribe to Our Newsletter.

Get updates straight to your inbox. No spam, just useful content.