Tokenless

Tokenless

Why Humans Can't Keep Up With AI-Written Code - Tariq Shaukat, Sonar

Interactive discovery

Explore the topic map

Follow the connections between themes, people, and ideas across the Tokenless archive in an interactive topic modeling map.

Open the map Browse posts

Machine Learning

View All
Judge a Transaction by the Company It Keeps — Somya Rai & MD Sharique, EXL

Judge a Transaction by the Company It Keeps — Somya Rai & MD Sharique, EXL

EXL developed an advanced fraud detection system that augments XGBoost with Graph Neural Network (GNN) embeddings. Traditional tabular models struggle to capture fraud signals residing in transaction neighborhoods. The system's innovative design includes meticulous sampling strategies, disjoint monthly graph construction for leakage control, and a GraphSAGE architecture that aggregates mean, max, and standard deviation of neighbor features to detect subtle fraud patterns. Emphasizing explainability for regulatory compliance and analyst trust, it also features a highly optimized serving architecture achieving 3ms P99 latency, pivoting to edge prediction to reduce cache footprint from 60GB to 2-3GB. This led to a 27-33% relative lift in true positive rates and a projected $65 million incremental fraud capture.

From 15% to 90% GPU Utilization: Fix the Data Pipeline, Not the Model

From 15% to 90% GPU Utilization: Fix the Data Pipeline, Not the Model

Tarun Sunkaraneni from Amazon AGI shows how a multimodal SFT pipeline that spent about 85% of its time waiting on data was brought to roughly 90% GPU utilization. He walks through concurrency with asyncio and Ray actors, prefetching, zero-copy transfer via Ray's object store, and a network-card bottleneck that appears only at scale, and argues that the hardest part of training throughput is often keeping GPUs fed rather than optimizing the model.

Small Models, Big Results: Training a Finance Agent for Under $500 — Charles Dickens, Snorkel AI

Small Models, Big Results: Training a Finance Agent for Under $500 — Charles Dickens, Snorkel AI

Snorkel AI and UC Berkeley's Sky Computing Lab show that a 4B Qwen3 model, trained with reinforcement learning for under $500 using the rLLM framework, beats its 235B sibling on expert-validated financial question answering built from SEC 10-K filings. The talk covers the FinQA dataset construction and verification, common failure modes of frontier models, transfer to multi-table and general tool-use tasks, and ablations showing that simple data and binary rewards outperform more elaborate setups, since the real bottleneck is disciplined tool use rather than reasoning depth.

Artificial Intelligence

View All
Why Humans Can't Keep Up With AI-Written Code - Tariq Shaukat, Sonar

Why Humans Can't Keep Up With AI-Written Code - Tariq Shaukat, Sonar

Sonar CEO Tariq Shaukat argues that agents have made code abundant but confidence scarce, and draws on Toyota's quality-first factory principles to show how to build software factories enterprises can trust. He covers five hard problems that break agentic development and presents Sonar's code confidence formula: intent, guide rails, verification, and evidence.

From AI Slop to Software Factories ft. Dexter Horthy

From AI Slop to Software Factories ft. Dexter Horthy

A tandem bike ride through Amsterdam turns into a wide-ranging conversation with Dexter Horthy, co-founder of HumanLayer, on code no one understands, computer use, MCP design, browser agents, chat interfaces, and the infrastructure every team needs for agent-based software factories.

Crusoe CEO Chase Lochmiller: Turning Stranded Energy Into Intelligence

Crusoe CEO Chase Lochmiller: Turning Stranded Energy Into Intelligence

Chase Lochmiller, founder and CEO of Crusoe, discusses building a vertically integrated AI infrastructure company spanning energy, data centers, manufacturing, and managed AI cloud. Topics include leading a complex organization, the Bitcoin-to-AI pivot, energy-first compute, executive coaching, firing decisions, community pushback on data centers, and lessons from climbing Everest.

Technology

View All
Why Founders Are Betting Big on Factories, Mines, and Energy

Why Founders Are Betting Big on Factories, Mines, and Energy

Erin Price-Wright and Connor Love unpack the AD50 and the rebuilding of America's industrial base, covering how defense demand is financing manufacturing capacity for commercial markets, how AI is reshaping factory economics, how a new generation of founders applies lessons from SpaceX, Tesla, Anduril, and Palantir to mining, energy, and manufacturing, and why private capital is now willing to fund physical infrastructure before government demand is guaranteed.

Mark Cuban’s Plan to Make Healthcare Affordable

Mark Cuban’s Plan to Make Healthcare Affordable

Mark Cuban and Julie Yoo discuss how transparency, direct contracting, and AI could reshape healthcare economics, from Cost Plus Drugs and modular pod manufacturing to personalized medicine, the future of physicians, and advice for founders who want to use AI to learn rather than to stop thinking.

Exploits Now Beat Patches: Open Source Security in the AI Era - Patrick Smyth, Chainguard

Exploits Now Beat Patches: Open Source Security in the AI Era - Patrick Smyth, Chainguard

Patrick Smyth of Chainguard examines how frontier AI has compressed the time between vulnerability disclosure and exploitation, leaving 30-day remediation cycles obsolete. The talk covers AI-assisted attacks, waves of supply chain malware, four attack surfaces spanning malware, known CVEs, zero days, and side doors like CI/CD, developer laptops, and agent skills, and practical defenses including cooldown periods, faster CVE remediation, and signing artifacts with SLSA and Sigstore.

Recent Post

The Next Medium: Why Real-Time Interactive Video Changes Everything — Ahmed Ahres, Reactor

The Next Medium: Why Real-Time Interactive Video Changes Everything — Ahmed Ahres, Reactor

Ahmed Ahres argues that real-time interaction fundamentally changes the medium, not just its speed, especially in generative AI. He defines "world models" as interactive, effectively infinite, and steerable video, drawing parallels with GPS and camera viewfinders. This paradigm shift unlocks new forms of control, intelligent advertising, programmable worlds for robotics and education, and advanced live avatars. He highlights the critical infrastructure challenges of streaming pixels, managing stateful sessions, and achieving global sub-100ms latency, emphasizing that batch infrastructure is unsuitable for real-time applications. Evaluation of consistency for these models remains an unsolved problem.

Infra behind Krea 2: How to train and serve at scale — Gabriel Jorge Menezes, Krea.ai

Infra behind Krea 2: How to train and serve at scale — Gabriel Jorge Menezes, Krea.ai

Krea's Gabriel Jorge Menezes shares critical insights into building the infrastructure for large-scale ML model training and serving. Key takeaways include the necessity of custom metrics beyond standard GPU utilization, aggressive checkpointing on ultra-fast storage to counter frequent cluster crashes, and a dynamic Kubernetes-based system using gang scheduling, virtual-kubelet, and taints to seamlessly shift inference workloads to external providers when training consumes on-prem GPUs. The approach highlights practical solutions for silent failures, thermal management, and optimizing resource utilization in a unified production and training environment.

Elon's Former Battery Chief on Making Transformers 100x Smaller | Drew Baglino, Heron Power

Elon's Former Battery Chief on Making Transformers 100x Smaller | Drew Baglino, Heron Power

Drew Baglino, former Tesla Powertrain & Energy head and now CEO of Heron Power, reveals why the current electricity grid is inadequate for the explosive growth of AI data centers. He explains how Heron Power's wideband gap power semiconductors will revolutionize grid-to-chip infrastructure, cutting power losses by half, shrinking massive transformers by 100x, and transforming data centers into grid-positive assets for a more efficient and sustainable energy future.

Training Krea 2: What matters in generative model training — Sangwu Lee, Krea.ai

Training Krea 2: What matters in generative model training — Sangwu Lee, Krea.ai

The talk by Sangwha Lee discusses Krea 2's open-source medium variant, emphasizing stylistic diversity and rapid iteration over the consistency-focused approach of larger models. A significant portion details their robust data curation pipeline, including unique methods for deduplication, filtering out AI-generated images, utilizing sparse autoencoders for unsupervised tagging, and ensuring world knowledge coverage. He outlines an LLM-inspired multi-stage training process, culminating in a prompt expander, and shares insights on fast iteration and future directions for image generation, highlighting the increasing integration of VLM advancements.

AI Agents Gone Rogue? Build, Defend & Attack AI-Enabled Apps • Katie Paxton-Fear • YOW! 2025

AI Agents Gone Rogue? Build, Defend & Attack AI-Enabled Apps • Katie Paxton-Fear • YOW! 2025

Katie Paxton-Fear explores the emerging security landscape of AI agents, moving beyond chatbots to autonomous, specialized entities. She details five critical vulnerabilities: social engineering, hacking frameworks, malicious agents, AI as accidental insiders (vibe coding), and the rise of hackbots. The talk concludes with a powerful call to action for security professionals to proactively engage and influence AI agent development, emphasizing that 'abstinence-only education doesn't work' when it comes to AI adoption.

Rich Sutton and Khurram Javed: Why AI Models Stop Learning, and How to Start It Again

Rich Sutton and Khurram Javed: Why AI Models Stop Learning, and How to Start It Again

Rich Sutton and Khurram Javed discuss their radical vision for AI at Oak Lab, advocating for truly continual learning agents that learn from their own experience, rejecting synthetic data due to the "Big World Hypothesis," and outlining a path to overcome catastrophic forgetting with "continual backprop" for a trillion-parameter, self-maintaining mind, while critiquing LLMs as only a fraction of intelligence.

← PreviousNext →

Stay In The Loop! Subscribe to Our Newsletter.

Get updates straight to your inbox. No spam, just useful content.