Tokenless

Interactive discovery

Explore the topic map

Follow the connections between themes, people, and ideas across the Tokenless archive in an interactive topic modeling map.

Machine Learning

View All
Judge a Transaction by the Company It Keeps — Somya Rai & MD Sharique, EXL

Judge a Transaction by the Company It Keeps — Somya Rai & MD Sharique, EXL

EXL developed an advanced fraud detection system that augments XGBoost with Graph Neural Network (GNN) embeddings. Traditional tabular models struggle to capture fraud signals residing in transaction neighborhoods. The system's innovative design includes meticulous sampling strategies, disjoint monthly graph construction for leakage control, and a GraphSAGE architecture that aggregates mean, max, and standard deviation of neighbor features to detect subtle fraud patterns. Emphasizing explainability for regulatory compliance and analyst trust, it also features a highly optimized serving architecture achieving 3ms P99 latency, pivoting to edge prediction to reduce cache footprint from 60GB to 2-3GB. This led to a 27-33% relative lift in true positive rates and a projected $65 million incremental fraud capture.

From 15% to 90% GPU Utilization: Fix the Data Pipeline, Not the Model

From 15% to 90% GPU Utilization: Fix the Data Pipeline, Not the Model

Tarun Sunkaraneni from Amazon AGI shows how a multimodal SFT pipeline that spent about 85% of its time waiting on data was brought to roughly 90% GPU utilization. He walks through concurrency with asyncio and Ray actors, prefetching, zero-copy transfer via Ray's object store, and a network-card bottleneck that appears only at scale, and argues that the hardest part of training throughput is often keeping GPUs fed rather than optimizing the model.

Small Models, Big Results: Training a Finance Agent for Under $500 — Charles Dickens, Snorkel AI

Small Models, Big Results: Training a Finance Agent for Under $500 — Charles Dickens, Snorkel AI

Snorkel AI and UC Berkeley's Sky Computing Lab show that a 4B Qwen3 model, trained with reinforcement learning for under $500 using the rLLM framework, beats its 235B sibling on expert-validated financial question answering built from SEC 10-K filings. The talk covers the FinQA dataset construction and verification, common failure modes of frontier models, transfer to multi-table and general tool-use tasks, and ablations showing that simple data and binary rewards outperform more elaborate setups, since the real bottleneck is disciplined tool use rather than reasoning depth.

Artificial Intelligence

View All
Why AI Could Turn Small Law Firms Into Billion-Dollar Businesses

Why AI Could Turn Small Law Firms Into Billion-Dollar Businesses

Eve CEO Jay Madheswaran joins a16z's Alex Rampell to explain how AI is automating plaintiff law end to end, expanding access to legal representation by making previously uneconomical cases viable, and why the economics point toward outcome-based pricing, agent-to-agent negotiation, and a fundamentally different law firm structure.

Why Everyone Is About To Have Their Own Database

Why Everyone Is About To Have Their Own Database

Paul Copplestone, CEO of Supabase, explains how the open-source Postgres platform grew to 13 million users and nearly 50 million databases by becoming the default backend for agents and a new class of non-engineer builders. He covers the shift from dashboard to API to code-first products, personal databases that individuals own, scaling Postgres to billions of databases, and designing tools so agents can recover from errors on their own.

AI exposes a major web security flaw, plus a new kind of voice model

AI exposes a major web security flaw, plus a new kind of voice model

This week's panel examines a critical PHP vulnerability that AI tools are surfacing faster than organizations can patch, a voice model from Block that listens and speaks simultaneously, and a cultural riddle benchmark that exposes how evaluation rewards guessing over admitting uncertainty. The episode closes with an IBM TechXchange report on streaming data architecture for AI agents.

Technology

View All
Why Founders Are Betting Big on Factories, Mines, and Energy

Why Founders Are Betting Big on Factories, Mines, and Energy

Erin Price-Wright and Connor Love unpack the AD50 and the rebuilding of America's industrial base, covering how defense demand is financing manufacturing capacity for commercial markets, how AI is reshaping factory economics, how a new generation of founders applies lessons from SpaceX, Tesla, Anduril, and Palantir to mining, energy, and manufacturing, and why private capital is now willing to fund physical infrastructure before government demand is guaranteed.

Mark Cuban’s Plan to Make Healthcare Affordable

Mark Cuban’s Plan to Make Healthcare Affordable

Mark Cuban and Julie Yoo discuss how transparency, direct contracting, and AI could reshape healthcare economics, from Cost Plus Drugs and modular pod manufacturing to personalized medicine, the future of physicians, and advice for founders who want to use AI to learn rather than to stop thinking.

Exploits Now Beat Patches: Open Source Security in the AI Era - Patrick Smyth, Chainguard

Exploits Now Beat Patches: Open Source Security in the AI Era - Patrick Smyth, Chainguard

Patrick Smyth of Chainguard examines how frontier AI has compressed the time between vulnerability disclosure and exploitation, leaving 30-day remediation cycles obsolete. The talk covers AI-assisted attacks, waves of supply chain malware, four attack surfaces spanning malware, known CVEs, zero days, and side doors like CI/CD, developer laptops, and agent skills, and practical defenses including cooldown periods, faster CVE remediation, and signing artifacts with SLSA and Sigstore.


Recent Post

How Forward Deployed Engineering is done at Kepler — Vinoo Ganesh

How Forward Deployed Engineering is done at Kepler — Vinoo Ganesh

Vinoo Ganesh, formerly of Palantir, details how Forward Deployed Engineering (FDE) functions as a critical product strategy rather than a sales role. He shares insights from Palantir's Foundry development, emphasizing how FDEs embed with customers to uncover true problems, observe user behavior, define a common linguistic ontology, and build production-ready solutions from temporary fixes, ultimately driving core product leverage.

OpenAI’s Plan to Make ChatGPT the Everything App — Akshay Nathan, OpenAI

OpenAI’s Plan to Make ChatGPT the Everything App — Akshay Nathan, OpenAI

Akshay Nathan, head of Core Product Engineering at OpenAI, discusses the journey and rationale behind ChatGPT Work. He explains how Codex's unexpected adoption by non-developers led to a unified agent harness, blurring the lines between developer and knowledge worker tools. The conversation delves into model capabilities, the role of artifacts and interactive 'Sites' in replacing traditional documents, and how AI fosters a new era of 'T-shaped' generalists. Nathan emphasizes the shift in productivity bottlenecks to 'ideas and taste' and the importance of 'quality at-bats' over mere 'motion' in an AI-powered development landscape.

The Next Frontier of AI Is Spatial Intelligence | Fei-Fei Li on a16z

The Next Frontier of AI Is Spatial Intelligence | Fei-Fei Li on a16z

Fei-Fei Li and Yunzhu Li discuss World Labs' acquisition of SceniX, focusing on building "spatial intelligence" and "large world models" to enable robots to understand and interact with the physical world. They elaborate on SceniX's "real-to-sim-to-real" pipeline, emphasizing how simulation, coupled with generative models like Marble, addresses the data bottleneck in robotics by providing consistent, scalable, and efficient training and evaluation environments. The conversation covers the role of counterfactual reasoning, the development of robotics foundation models, and the strategic focus on semi-structured environments for pragmatic, reliable robot deployment.

Serving 2 Million Models Without Melting: Scaling the Hugging Face Hub — Arek Borucki, Hugging Face

Serving 2 Million Models Without Melting: Scaling the Hugging Face Hub — Arek Borucki, Hugging Face

Arek Borucki details how Hugging Face scales its infrastructure to serve millions of models and users, focusing on the evolution of search architecture using MongoDB Atlas and Apache Lucene, robust database scaling with a seven-node cluster and sharding, and dynamic frontend autoscaling with Kubernetes and KEDA to ensure an instant, seamless user experience.

Green AI: Making Machine Learning Environmentally Sustainable • Charles Humble • YOW! 2025

Green AI: Making Machine Learning Environmentally Sustainable • Charles Humble • YOW! 2025

Charles Humble explores the significant environmental impact of AI, particularly generative AI, on global carbon emissions. He offers practical, actionable strategies across the entire AI lifecycle—from project planning and data collection to training and deployment—to reduce this footprint. Key recommendations include questioning the necessity of AI solutions, choosing open-source models, leveraging carbon-aware computing for demand shifting, employing model compression techniques like distillation and quantization, and integrating sustainability as a fundamental architectural principle in software engineering.

What Actually Makes an Algorithm Terrifying (with Cathy O'Neil)

What Actually Makes an Algorithm Terrifying (with Cathy O'Neil)

Dr. Cathy O'Neil, author of "Weapons of Math Destruction," asserts that terrifying algorithms are defined by secrecy, unaccountability, and a lack of opt-out, not mathematical complexity. She details how Taylorism's labor degradation now extends to white-collar jobs via AI surveillance. O'Neil discusses her firms, ORCAA and OCEAN, which provide statistical evidence for lawsuits against tech giants and advocate for algorithmic accountability through "cockpits" of metrics and transparent auditing, urging collective action against unchecked technological power.

Stay In The Loop! Subscribe to Our Newsletter.

Get updates straight to your inbox. No spam, just useful content.