Tokenless

Tokenless

Why Humans Can't Keep Up With AI-Written Code - Tariq Shaukat, Sonar

Interactive discovery

Explore the topic map

Follow the connections between themes, people, and ideas across the Tokenless archive in an interactive topic modeling map.

Open the map Browse posts

Machine Learning

View All
Judge a Transaction by the Company It Keeps — Somya Rai & MD Sharique, EXL

Judge a Transaction by the Company It Keeps — Somya Rai & MD Sharique, EXL

EXL developed an advanced fraud detection system that augments XGBoost with Graph Neural Network (GNN) embeddings. Traditional tabular models struggle to capture fraud signals residing in transaction neighborhoods. The system's innovative design includes meticulous sampling strategies, disjoint monthly graph construction for leakage control, and a GraphSAGE architecture that aggregates mean, max, and standard deviation of neighbor features to detect subtle fraud patterns. Emphasizing explainability for regulatory compliance and analyst trust, it also features a highly optimized serving architecture achieving 3ms P99 latency, pivoting to edge prediction to reduce cache footprint from 60GB to 2-3GB. This led to a 27-33% relative lift in true positive rates and a projected $65 million incremental fraud capture.

From 15% to 90% GPU Utilization: Fix the Data Pipeline, Not the Model

From 15% to 90% GPU Utilization: Fix the Data Pipeline, Not the Model

Tarun Sunkaraneni from Amazon AGI shows how a multimodal SFT pipeline that spent about 85% of its time waiting on data was brought to roughly 90% GPU utilization. He walks through concurrency with asyncio and Ray actors, prefetching, zero-copy transfer via Ray's object store, and a network-card bottleneck that appears only at scale, and argues that the hardest part of training throughput is often keeping GPUs fed rather than optimizing the model.

Small Models, Big Results: Training a Finance Agent for Under $500 — Charles Dickens, Snorkel AI

Small Models, Big Results: Training a Finance Agent for Under $500 — Charles Dickens, Snorkel AI

Snorkel AI and UC Berkeley's Sky Computing Lab show that a 4B Qwen3 model, trained with reinforcement learning for under $500 using the rLLM framework, beats its 235B sibling on expert-validated financial question answering built from SEC 10-K filings. The talk covers the FinQA dataset construction and verification, common failure modes of frontier models, transfer to multi-table and general tool-use tasks, and ablations showing that simple data and binary rewards outperform more elaborate setups, since the real bottleneck is disciplined tool use rather than reasoning depth.

Artificial Intelligence

View All
Why Humans Can't Keep Up With AI-Written Code - Tariq Shaukat, Sonar

Why Humans Can't Keep Up With AI-Written Code - Tariq Shaukat, Sonar

Sonar CEO Tariq Shaukat argues that agents have made code abundant but confidence scarce, and draws on Toyota's quality-first factory principles to show how to build software factories enterprises can trust. He covers five hard problems that break agentic development and presents Sonar's code confidence formula: intent, guide rails, verification, and evidence.

From AI Slop to Software Factories ft. Dexter Horthy

From AI Slop to Software Factories ft. Dexter Horthy

A tandem bike ride through Amsterdam turns into a wide-ranging conversation with Dexter Horthy, co-founder of HumanLayer, on code no one understands, computer use, MCP design, browser agents, chat interfaces, and the infrastructure every team needs for agent-based software factories.

Crusoe CEO Chase Lochmiller: Turning Stranded Energy Into Intelligence

Crusoe CEO Chase Lochmiller: Turning Stranded Energy Into Intelligence

Chase Lochmiller, founder and CEO of Crusoe, discusses building a vertically integrated AI infrastructure company spanning energy, data centers, manufacturing, and managed AI cloud. Topics include leading a complex organization, the Bitcoin-to-AI pivot, energy-first compute, executive coaching, firing decisions, community pushback on data centers, and lessons from climbing Everest.

Technology

View All
Why Founders Are Betting Big on Factories, Mines, and Energy

Why Founders Are Betting Big on Factories, Mines, and Energy

Erin Price-Wright and Connor Love unpack the AD50 and the rebuilding of America's industrial base, covering how defense demand is financing manufacturing capacity for commercial markets, how AI is reshaping factory economics, how a new generation of founders applies lessons from SpaceX, Tesla, Anduril, and Palantir to mining, energy, and manufacturing, and why private capital is now willing to fund physical infrastructure before government demand is guaranteed.

Mark Cuban’s Plan to Make Healthcare Affordable

Mark Cuban’s Plan to Make Healthcare Affordable

Mark Cuban and Julie Yoo discuss how transparency, direct contracting, and AI could reshape healthcare economics, from Cost Plus Drugs and modular pod manufacturing to personalized medicine, the future of physicians, and advice for founders who want to use AI to learn rather than to stop thinking.

Exploits Now Beat Patches: Open Source Security in the AI Era - Patrick Smyth, Chainguard

Exploits Now Beat Patches: Open Source Security in the AI Era - Patrick Smyth, Chainguard

Patrick Smyth of Chainguard examines how frontier AI has compressed the time between vulnerability disclosure and exploitation, leaving 30-day remediation cycles obsolete. The talk covers AI-assisted attacks, waves of supply chain malware, four attack surfaces spanning malware, known CVEs, zero days, and side doors like CI/CD, developer laptops, and agent skills, and practical defenses including cooldown periods, faster CVE remediation, and signing artifacts with SLSA and Sigstore.

Recent Post

How Companies Are Building Their Own Intelligence | Sonya Huang, Sequoia Capital

How Companies Are Building Their Own Intelligence | Sonya Huang, Sequoia Capital

Sonya Huang of Sequoia Capital discusses the strategic imperative for companies to embrace "sovereign AI" by owning their AI models and weights. She identifies cost, speed, performance, and controlling destiny as the four driving forces behind this shift. Huang argues that the competitive landscape is moving towards owning the intelligence layer, positioning application companies as the new innovation labs. She provides a practical, opinionated framework covering strategy (what to own vs. rent), team building, ensuring external legibility of research, and a technical roadmap for implementation, emphasizing how open-weight models now enable frontier-level performance through ownership and customization.

The RAG Mistake Almost Every Team Is Making (with Pete Johnson)

The RAG Mistake Almost Every Team Is Making (with Pete Johnson)

Pete Johnson, Field CTO of AI at MongoDB, discusses effective AI strategies, why most organizations struggle with AI ROI, and how to build reliable AI systems. He covers the importance of choosing the right embedding models for RAG pipelines, introduces Matryoshka embeddings, and explains the evolution of agentic memory to combat token maxing and ensure consistency in production AI.

Agents, codebases, and teams — Aditya Khandelwal, Amazon AGI Lab

Agents, codebases, and teams — Aditya Khandelwal, Amazon AGI Lab

Aditya Khandelwal argues that scaling AI agent adoption within engineering teams is a leadership challenge, not an individual contributor problem. He highlights common pitfalls like agent "babysitting" and "slop," and provides a playbook emphasizing progressive disclosure, high-value automation, robust feedback loops, and a critical mindset shift to successfully integrate agents into team workflows.

Why Deep Networks Don’t Need to Memorize Everything — Matthieu Wyart

Why Deep Networks Don’t Need to Memorize Everything — Matthieu Wyart

Matthieu Wyart, a statistical physicist, argues that deep networks discover abstractions by recovering hidden data hierarchies, allowing them to escape the curse of dimensionality. He explains how this mechanism, combined with predicting latent representations instead of raw tokens, can significantly improve sample efficiency. The discussion also covers the physics of rough loss landscapes, machine creativity, diffusion models, and a theoretical framework for neural scaling laws.

Peter Steinberger: What Happens When 4.7 Million People Let It Cook

Peter Steinberger: What Happens When 4.7 Million People Let It Cook

Peter Steinberger, founder of OpenClaw, shares the candid story of building one of the world's largest open-source AI projects. Starting from a personal annoyance, OpenClaw went viral, leading to both immense success and unforeseen challenges, including burnout, security pressures, and feature creep. He offers invaluable lessons on product-market fit, managing hyper-growth in open source, the peril of dependencies, and the philosophy that "fun is velocity" in building impactful technology.

Taking Reinforcement Learning Cross Datacenter — Nan Jiang, Modal

Taking Reinforcement Learning Cross Datacenter — Nan Jiang, Modal

Nan Jiang introduces "Adam absorption" to revolutionize RL model synchronization. By exploiting finite precision serving and small Adam steps, less than 1% of served model weights actually change, allowing for 500MB patches instead of 500GB checkpoints. This enables a distributed "bulletin board" architecture, decoupling trainers from global rollout fleets and unlocking elastic, cross-region GPU capacity for RL.

← PreviousNext →

Stay In The Loop! Subscribe to Our Newsletter.

Get updates straight to your inbox. No spam, just useful content.