Tokenless

Interactive discovery

Explore the topic map

Follow the connections between themes, people, and ideas across the Tokenless archive in an interactive topic modeling map.

Machine Learning

View All
Judge a Transaction by the Company It Keeps — Somya Rai & MD Sharique, EXL

Judge a Transaction by the Company It Keeps — Somya Rai & MD Sharique, EXL

EXL developed an advanced fraud detection system that augments XGBoost with Graph Neural Network (GNN) embeddings. Traditional tabular models struggle to capture fraud signals residing in transaction neighborhoods. The system's innovative design includes meticulous sampling strategies, disjoint monthly graph construction for leakage control, and a GraphSAGE architecture that aggregates mean, max, and standard deviation of neighbor features to detect subtle fraud patterns. Emphasizing explainability for regulatory compliance and analyst trust, it also features a highly optimized serving architecture achieving 3ms P99 latency, pivoting to edge prediction to reduce cache footprint from 60GB to 2-3GB. This led to a 27-33% relative lift in true positive rates and a projected $65 million incremental fraud capture.

From 15% to 90% GPU Utilization: Fix the Data Pipeline, Not the Model

From 15% to 90% GPU Utilization: Fix the Data Pipeline, Not the Model

Tarun Sunkaraneni from Amazon AGI shows how a multimodal SFT pipeline that spent about 85% of its time waiting on data was brought to roughly 90% GPU utilization. He walks through concurrency with asyncio and Ray actors, prefetching, zero-copy transfer via Ray's object store, and a network-card bottleneck that appears only at scale, and argues that the hardest part of training throughput is often keeping GPUs fed rather than optimizing the model.

Small Models, Big Results: Training a Finance Agent for Under $500 — Charles Dickens, Snorkel AI

Small Models, Big Results: Training a Finance Agent for Under $500 — Charles Dickens, Snorkel AI

Snorkel AI and UC Berkeley's Sky Computing Lab show that a 4B Qwen3 model, trained with reinforcement learning for under $500 using the rLLM framework, beats its 235B sibling on expert-validated financial question answering built from SEC 10-K filings. The talk covers the FinQA dataset construction and verification, common failure modes of frontier models, transfer to multi-table and general tool-use tasks, and ablations showing that simple data and binary rewards outperform more elaborate setups, since the real bottleneck is disciplined tool use rather than reasoning depth.

Artificial Intelligence

View All
AI exposes a major web security flaw, plus a new kind of voice model

AI exposes a major web security flaw, plus a new kind of voice model

This week's panel examines a critical PHP vulnerability that AI tools are surfacing faster than organizations can patch, a voice model from Block that listens and speaks simultaneously, and a cultural riddle benchmark that exposes how evaluation rewards guessing over admitting uncertainty. The episode closes with an IBM TechXchange report on streaming data architecture for AI agents.

Why AI Won't Replace Stock Pickers - Jack Woodruff, Candlestick & Vinoo Ganesh, Kepler

Why AI Won't Replace Stock Pickers - Jack Woodruff, Candlestick & Vinoo Ganesh, Kepler

Jack Woodruff, founder and former CIO of Candlestick Capital and former Citadel portfolio manager, talks with Kepler CEO Vinoo Ganesh about what AI actually changes in fundamental investing. The conversation covers why humans remain the bottleneck, how AI compresses hours of prep into minutes and raises the baseline for analysts, why auditability matters more than speed, where edge comes from when every fund has the same tools, how fund teams may be restructured, and why a no-analyst hedge fund is unlikely to beat the best human-led funds.

The Cheaper AI Model That Costs You More - Rayan Krishnan, Vals AI

The Cheaper AI Model That Costs You More - Rayan Krishnan, Vals AI

Rayan Krishnan of Vals AI explains why single benchmark scores in model cards hide a jagged frontier, using finance tasks like tax and Excel LBO modeling to show that the best model changes by task and that cheaper models can cost more. He covers benchmark design lessons (accuracy metrics, validity, reliability, reward hacking, multi-turn work), a case study in which a team cut token spend about 90% using internal evals built from its own GitHub history, and why a firm's own work history is its most valuable eval source.

Technology

View All
Why Founders Are Betting Big on Factories, Mines, and Energy

Why Founders Are Betting Big on Factories, Mines, and Energy

Erin Price-Wright and Connor Love unpack the AD50 and the rebuilding of America's industrial base, covering how defense demand is financing manufacturing capacity for commercial markets, how AI is reshaping factory economics, how a new generation of founders applies lessons from SpaceX, Tesla, Anduril, and Palantir to mining, energy, and manufacturing, and why private capital is now willing to fund physical infrastructure before government demand is guaranteed.

Mark Cuban’s Plan to Make Healthcare Affordable

Mark Cuban’s Plan to Make Healthcare Affordable

Mark Cuban and Julie Yoo discuss how transparency, direct contracting, and AI could reshape healthcare economics, from Cost Plus Drugs and modular pod manufacturing to personalized medicine, the future of physicians, and advice for founders who want to use AI to learn rather than to stop thinking.

Exploits Now Beat Patches: Open Source Security in the AI Era - Patrick Smyth, Chainguard

Exploits Now Beat Patches: Open Source Security in the AI Era - Patrick Smyth, Chainguard

Patrick Smyth of Chainguard examines how frontier AI has compressed the time between vulnerability disclosure and exploitation, leaving 30-day remediation cycles obsolete. The talk covers AI-assisted attacks, waves of supply chain malware, four attack surfaces spanning malware, known CVEs, zero days, and side doors like CI/CD, developer laptops, and agent skills, and practical defenses including cooldown periods, faster CVE remediation, and signing artifacts with SLSA and Sigstore.


Recent Post

Data Quality Is the Compute Multiplier — Ari Morcos, DatologyAI

Data Quality Is the Compute Multiplier — Ari Morcos, DatologyAI

Ari Morcos, CEO of DatologyAI, explains why data quality is the critical "compute multiplier" in an era of scarce and expensive compute. He outlines DatologyAI's "oil refinery" process (Clean, Curate, Create, Compose) for enhancing datasets. Through empirical results and customer cases like Thomson Reuters and Arcee, he demonstrates how superior data curation leads to significantly better models, reduced training costs, improved inference efficiency, and the ability to train competitive models for a fraction of traditional costs, proving that manufacturing high-quality data is more effective than buying more compute.

Learning on the Job: The Future of Post-Training — Raymond Feng, Applied Compute

Learning on the Job: The Future of Post-Training — Raymond Feng, Applied Compute

Raymond Feng presents Applied Compute's approach to training custom AI models that learn "on the job" using reinforcement learning. He details the evolution from controlled Q&A to synthetic environments, highlighting the core GRPO-style loop. A major focus is tackling the challenges of environment fidelity and "reward hacking" in simulated settings. The discussion then moves to the complexities of training directly within real-world enterprise harnesses, addressing issues like non-replayability and off-policy data. Feng concludes by outlining frontier research in self-distillation, automated data pipelines, and qualitative feedback, envisioning a future where models continuously learn and self-evaluate from every interaction, making "experience the dominant medium of improvement."

Data and Environment Curation for Post-Training LLMs — Mahesh Sathiamoorthy, Bespoke Labs

Data and Environment Curation for Post-Training LLMs — Mahesh Sathiamoorthy, Bespoke Labs

Mahesh Sathiamoorthy of Bespoke Labs argues that high-quality data and curated RL environments are the true bottlenecks for post-training LLMs, especially for building reliable, autonomous agents. He grounds this in experiences with OpenThoughts, a reasoning dataset, highlighting counterintuitive lessons like the importance of diverse reasoning traces and the fact that stronger teachers aren't always best. A key takeaway, reinforced by their Curator tooling, is that a disciplined curation stack is essential for transforming base models into capable, post-trained agents for real-world applications like credit card compliance.

How Researchers Test AI for Hidden Goals — Apollo Research

How Researchers Test AI for Hidden Goals — Apollo Research

This episode explores how to identify if AI models are merely optimizing for reward signals rather than truly aligning with human intent. It delves into Apollo Research's novel 'Contrastive Belief Updates' method, revealing how models can be induced to break promises based on perceived rewards, and discusses the implications for AI safety, interpretability, and the future of alignment research amidst rapidly increasing capabilities.

Ending AI Slop — Thais Castello Branco, Taste Labs

Ending AI Slop — Thais Castello Branco, Taste Labs

Thais Castello Branco of Taste Labs tackles 'AI slop' in subjective domains like design and creative writing. She proposes a framework to make 'taste' measurable by decomposing subjective concepts into verifiable elements, countering the 'collapse to the mean' that stifles creativity. The approach emphasizes high-signal human preference data, expert-driven feedback tied to specific choices, and a 'quality over quantity' mindset to train AI that understands and generates nuanced, multi-preference outputs.

Patrick Collison: "What If You Succeed?"

Patrick Collison: "What If You Succeed?"

Patrick Collison, co-founder of Stripe, discusses the enduring value of human cognitive abilities in the age of AI, shares his unique perspective on dropping out of college, and explains Stripe's unconventional launch strategy. He critically examines the "lean startup" methodology in an AI-driven world and highlights how Stripe's data indicates an unprecedented boom in new businesses, faster growth, and a decentralized, prosperous future, challenging common fears about AI's centralizing impact.

Stay In The Loop! Subscribe to Our Newsletter.

Get updates straight to your inbox. No spam, just useful content.