Tokenless

Tokenless

Agents That Self Improve While You Sleep - Fuad Ali, Arize AI

Interactive discovery

Explore the topic map

Follow the connections between themes, people, and ideas across the Tokenless archive in an interactive topic modeling map.

Open the map Browse posts

Machine Learning

View All
Judge a Transaction by the Company It Keeps — Somya Rai & MD Sharique, EXL

Judge a Transaction by the Company It Keeps — Somya Rai & MD Sharique, EXL

EXL developed an advanced fraud detection system that augments XGBoost with Graph Neural Network (GNN) embeddings. Traditional tabular models struggle to capture fraud signals residing in transaction neighborhoods. The system's innovative design includes meticulous sampling strategies, disjoint monthly graph construction for leakage control, and a GraphSAGE architecture that aggregates mean, max, and standard deviation of neighbor features to detect subtle fraud patterns. Emphasizing explainability for regulatory compliance and analyst trust, it also features a highly optimized serving architecture achieving 3ms P99 latency, pivoting to edge prediction to reduce cache footprint from 60GB to 2-3GB. This led to a 27-33% relative lift in true positive rates and a projected $65 million incremental fraud capture.

From 15% to 90% GPU Utilization: Fix the Data Pipeline, Not the Model

From 15% to 90% GPU Utilization: Fix the Data Pipeline, Not the Model

Tarun Sunkaraneni from Amazon AGI shows how a multimodal SFT pipeline that spent about 85% of its time waiting on data was brought to roughly 90% GPU utilization. He walks through concurrency with asyncio and Ray actors, prefetching, zero-copy transfer via Ray's object store, and a network-card bottleneck that appears only at scale, and argues that the hardest part of training throughput is often keeping GPUs fed rather than optimizing the model.

Small Models, Big Results: Training a Finance Agent for Under $500 — Charles Dickens, Snorkel AI

Small Models, Big Results: Training a Finance Agent for Under $500 — Charles Dickens, Snorkel AI

Snorkel AI and UC Berkeley's Sky Computing Lab show that a 4B Qwen3 model, trained with reinforcement learning for under $500 using the rLLM framework, beats its 235B sibling on expert-validated financial question answering built from SEC 10-K filings. The talk covers the FinQA dataset construction and verification, common failure modes of frontier models, transfer to multi-table and general tool-use tasks, and ablations showing that simple data and binary rewards outperform more elaborate setups, since the real bottleneck is disciplined tool use rather than reasoning depth.

Artificial Intelligence

View All
How a Trading Firm Ships New AI Models the Same Day - Noyan Tokgozoglu, Optiver

How a Trading Firm Ships New AI Models the Same Day - Noyan Tokgozoglu, Optiver

A look at how Optiver, a proprietary trading firm, runs an on-prem AI platform where every model, agent, and harness decision has to show results in P&L within hours. Topics include the inference gateway, same-day adoption of frontier models, the meta harness design, and efforts to bring AI spend back under control.

Agents That Self Improve While You Sleep - Fuad Ali, Arize AI

Agents That Self Improve While You Sleep - Fuad Ali, Arize AI

A workshop on building a self-improvement loop for AI agents: tracing production traces, using an always-on agent to file deduplicated issues, turning failures into evals and regression datasets, proving fixes with experiments, and keeping humans at the highest-leverage review points.

How to Build Voice Agents That Don't Fall Apart When You Interrupt - Jesse Hall, LiveKit

How to Build Voice Agents That Don't Fall Apart When You Interrupt - Jesse Hall, LiveKit

Jesse Hall of LiveKit explains how to build voice agents for financial services that feel human rather than robotic. The talk covers why model leaderboards mislead for real-time conversations, why time to first audio and time to first sentence matter more than first byte or first token, and how async tool calls keep a conversation flowing during slow back-end work. It also covers audio-aware turn detection, the roughly 1.5-second latency budget, and benchmarking your own stack with simulated callers.

Technology

View All
What will computer chips look like in 2045?

What will computer chips look like in 2045?

Intel's leadership walks through how advanced process nodes are brought to volume, from yield learning and the lessons of 10nm to the shift from planar transistors to gate-all-around, High-NA EUV, backside power, and CFET. The discussion widens to the chip-to-chip bottleneck that hybrid bonding targets, the supply limits on EUV tooling as AI compute demand grows, and the economics that make foundry scale decisive.

Former Intel CEO: Why This is the Best Time to Build Hardware

Former Intel CEO: Why This is the Best Time to Build Hardware

Pat Gelsinger joins a16z's Raghu Raghuram and Guido Appenzeller to discuss how AI is reshaping chip design, why design speed alone will not fix semiconductor bottlenecks, and why power and energy capacity may ultimately limit AI growth. The conversation covers HBM and memory innovation, stacking limits, the shift from copper to optics, consolidation among AI chip startups, and what a VMware for AI agents might look like.

Built Together: Inside the Dell + CoreWeave Engineering Partnership Powering Next-Gen AI

Built Together: Inside the Dell + CoreWeave Engineering Partnership Powering Next-Gen AI

A candid panel between Dell and CoreWeave leaders on co-engineering GB200, GB300, and Vera Rubin rack-scale AI platforms. The discussion covers why early access and stabilization matter in the AI arms race, how the industry moved from server-level to rack-as-computer architecture, and how joint development, standardized Redfish tooling, and shifting diagnostics left have enabled scale. It closes with where rack-scale infrastructure is heading toward pods, denser heterogeneous systems, and the need for automation in liquid cooling and power.

Recent Post

How to Build Financial Agents That Work Across the Web - Jay Sahnan & Arik Bird, Browserbase

How to Build Financial Agents That Work Across the Web - Jay Sahnan & Arik Bird, Browserbase

Browser agents for financial data behind logins and anti-bot protection. Covers Ramp, Bill, and Stripe case studies, why cloud browsers get blocked, how Browserbase forked Chromium for reliable data-center use, and how Stagehand's act, extract, and observe primitives keep automations resilient to site changes.

Do Not Let Models Invent Numbers - Vinoo Ganesh, Kepler

Do Not Let Models Invent Numbers - Vinoo Ganesh, Kepler

Vinoo Ganesh, CEO of Kepler, explains how the company builds a verifiable financial research platform. Models cite numbers but never write them. Deterministic code performs the math, a citation registry built from more than 30 million SEC documents anchors every figure, and a post-processing filter strips anything untraceable. The talk covers hybrid search and re-ranking on Turbopuffer, tenant isolation, and why plain RAG produced thousands of wrong numbers in evaluations.

Why Frontier Models Fail as Buy-Side Analysts - Janie Gu, Google DeepMind & Suyeol Yun, LinqAlpha

Why Frontier Models Fail as Buy-Side Analysts - Janie Gu, Google DeepMind & Suyeol Yun, LinqAlpha

Janie Gu of Google DeepMind and Kaggle explains why most AI benchmarks are unreliable: they don't reflect real work, they are costly to keep current, and their scores are hard to verify. Drawing on a reproduction of 65 industry benchmarks, she details the failure modes and how Kaggle is building auditable, containerized evaluation infrastructure. Suyeol Yun of LinqAlpha then presents MandateBench, which tests whether models can carry out buy-side equity analyst work from a fund mandate to a full investment memo.

AI Writes the Code. So What's Left for Engineers? - Laurie Voss, Arize AI

AI Writes the Code. So What's Left for Engineers? - Laurie Voss, Arize AI

Laurie Voss, head of developer relations at Arize AI and co-founder of npm, argues that coding agents have made writing code nearly free, so the bottleneck keeps moving first to code review, then to operations and security. What agents can't take over is discovering what people actually need and defining what 'good' means. He introduces the product engineer as the role that remains, examines the collapse in junior engineering hiring, and offers practical advice for engineering leaders.

Your Agent Fix Just Broke Something Else - Sofia Jakovcevic, Arize AI

Your Agent Fix Just Broke Something Else - Sofia Jakovcevic, Arize AI

Sofia Jakovcevic, a forward deployed engineer at Arize AI, argues that agents fail at runtime rather than in code, so regressions from a small prompt change can hide behind an improved metric. She walks through a five-step regression loop built on production traces, including dataset curation, LLM-as-a-judge evaluators, baseline experiments, comparisons, and CI merge gates, then shows how coding agents with access to traces can close the loop themselves.

How Bridgewater Turned 100 Million Documents Into an Edge - Sam Green & Aaron Linsky, Bridgewater

How Bridgewater Turned 100 Million Documents Into an Edge - Sam Green & Aaron Linsky, Bridgewater

Bridgewater Associates' Applied AI and product engineering leads explain how they built the Vault, a governed repository of more than 100 million unstructured documents, and why humans and agents need different things from the same search system. They cover a hand-built benchmark that lifted precision at 10 from about 60% to over 90%, the filtering and scaling choices behind it, and the shift toward proactive agents that bring investors the topics most deserving of their attention.

← PreviousNext →

Stay In The Loop! Subscribe to Our Newsletter.

Get updates straight to your inbox. No spam, just useful content.