Tokenless

Tokenless

Mark Cuban’s Plan to Make Healthcare Affordable

Interactive discovery

Explore the topic map

Follow the connections between themes, people, and ideas across the Tokenless archive in an interactive topic modeling map.

Open the map Browse posts

Machine Learning

View All
Judge a Transaction by the Company It Keeps — Somya Rai & MD Sharique, EXL

Judge a Transaction by the Company It Keeps — Somya Rai & MD Sharique, EXL

EXL developed an advanced fraud detection system that augments XGBoost with Graph Neural Network (GNN) embeddings. Traditional tabular models struggle to capture fraud signals residing in transaction neighborhoods. The system's innovative design includes meticulous sampling strategies, disjoint monthly graph construction for leakage control, and a GraphSAGE architecture that aggregates mean, max, and standard deviation of neighbor features to detect subtle fraud patterns. Emphasizing explainability for regulatory compliance and analyst trust, it also features a highly optimized serving architecture achieving 3ms P99 latency, pivoting to edge prediction to reduce cache footprint from 60GB to 2-3GB. This led to a 27-33% relative lift in true positive rates and a projected $65 million incremental fraud capture.

From 15% to 90% GPU Utilization: Fix the Data Pipeline, Not the Model

From 15% to 90% GPU Utilization: Fix the Data Pipeline, Not the Model

Tarun Sunkaraneni from Amazon AGI shows how a multimodal SFT pipeline that spent about 85% of its time waiting on data was brought to roughly 90% GPU utilization. He walks through concurrency with asyncio and Ray actors, prefetching, zero-copy transfer via Ray's object store, and a network-card bottleneck that appears only at scale, and argues that the hardest part of training throughput is often keeping GPUs fed rather than optimizing the model.

Small Models, Big Results: Training a Finance Agent for Under $500 — Charles Dickens, Snorkel AI

Small Models, Big Results: Training a Finance Agent for Under $500 — Charles Dickens, Snorkel AI

Snorkel AI and UC Berkeley's Sky Computing Lab show that a 4B Qwen3 model, trained with reinforcement learning for under $500 using the rLLM framework, beats its 235B sibling on expert-validated financial question answering built from SEC 10-K filings. The talk covers the FinQA dataset construction and verification, common failure modes of frontier models, transfer to multi-table and general tool-use tasks, and ablations showing that simple data and binary rewards outperform more elaborate setups, since the real bottleneck is disciplined tool use rather than reasoning depth.

Artificial Intelligence

View All
The PHP bug threatening the web. Plus, who's auditing AI?

The PHP bug threatening the web. Plus, who's auditing AI?

Security Intelligence panelists Nick, Don and Jim unpack three stories: two decades-old PHP flaws (PHP2Shell) that let attackers take over servers without logging in and were found by AI before patches landed, Anthropic's decision to give outside evaluators employee-like access and whether rival frontier labs should audit each other, and 333 Tor exit relays hijacked through a reused password. The discussion centers on visibility, patching under legacy constraints, secure by design, and the limits of trust in AI and anonymity networks.

Velocity Through Rigour: Then & Now • Cate Huston • Bug Bash EU 2026

Velocity Through Rigour: Then & Now • Cate Huston • Bug Bash EU 2026

Cate Huston, CTO at Twill and author of The Engineering Leader, shares how she rebuilt a no-code product into a production platform with a two-person team and agents, and argues that the management playbook for scaling people still applies to scaling AI agents. She covers the shift from f(n) to f(n × a) team scaling, the four management layers, guardrails and the roughly 30 percent of output she believes they require, shift-left practices, CI as a cost and quality lever, and why rigour is what turns speed into lasting velocity.

We Kept Rebuilding Our AI Agent. Here's What Survived - Fuad Ali, Arize AI

We Kept Rebuilding Our AI Agent. Here's What Survived - Fuad Ali, Arize AI

Arize's in-product agent Alex went from a 2023 prototype to a single harness-driven agent with planning, memory, and on-demand skills. AI PM Fuad Ali walks through the decisions behind each change, including moving the plan into the harness, making finish an explicit gate, treating large tool results like files, using one small memory file per user instead of vector stores or knowledge graphs, merging specialists into one agent, and using production sessions as tests.

Technology

View All
Mark Cuban’s Plan to Make Healthcare Affordable

Mark Cuban’s Plan to Make Healthcare Affordable

Mark Cuban and Julie Yoo discuss how transparency, direct contracting, and AI could reshape healthcare economics, from Cost Plus Drugs and modular pod manufacturing to personalized medicine, the future of physicians, and advice for founders who want to use AI to learn rather than to stop thinking.

Exploits Now Beat Patches: Open Source Security in the AI Era - Patrick Smyth, Chainguard

Exploits Now Beat Patches: Open Source Security in the AI Era - Patrick Smyth, Chainguard

Patrick Smyth of Chainguard examines how frontier AI has compressed the time between vulnerability disclosure and exploitation, leaving 30-day remediation cycles obsolete. The talk covers AI-assisted attacks, waves of supply chain malware, four attack surfaces spanning malware, known CVEs, zero days, and side doors like CI/CD, developer laptops, and agent skills, and practical defenses including cooldown periods, faster CVE remediation, and signing artifacts with SLSA and Sigstore.

Can Your AI Heat My House?

Can Your AI Heat My House?

A wide-ranging conversation on how AI inference is pushing cloud infrastructure, data centers, and hardware supply chains against physical limits, covering the rise of alt clouds, rack density and cooling, hardware lifecycles and circularity, talent shortages, heat reuse for communities, and what engineering leaders can do about resource-aware software.

Recent Post

Why LLM Recommenders Will Be AI's Biggest Consumer App — Devansh Tandon, Meta

Why LLM Recommenders Will Be AI's Biggest Consumer App — Devansh Tandon, Meta

Devansh Tandon, who leads Meta Recommendations Research, argues that recommendation systems scale like LLMs, that the field is early on that curve, and that LLM recommenders will become one of AI's biggest consumer applications. He walks through four S-curves of recommendation, a three-step recipe built on semantic IDs, and why content feeds can be up to 100x cheaper per hour of engagement than AI chat apps.

How to Spot Exceptional Talent Before Everyone Else

How to Spot Exceptional Talent Before Everyone Else

This episode introduces Cosign, a new platform designed to formalize professional reputation and endorsements within the startup community. It explores how human conviction and "cosigns" from respected individuals provide more valuable signals than traditional credentials, especially as AI makes information abundant. The discussion covers the platform's granular approach to endorsements, its aim to address the limitations of existing professional networks like LinkedIn and X, and its role in fostering talent discovery and social capital within Silicon Valley's meritocratic ecosystem.

Distill the LLM, Don't Serve It: Search & Personalization at DoorDash — Raghav Saboo, DoorDash

Distill the LLM, Don't Serve It: Search & Personalization at DoorDash — Raghav Saboo, DoorDash

Raghav Saboo, Staff ML Engineer at DoorDash, argues that semantic understanding, not engagement, is the real bottleneck in marketplace discovery. He walks through four LLM-driven primitives (graded relevance supervision, semantic IDs, multi-timescale consumer memory, and steerable personalized collections) and explains the core pattern of reasoning offline with LLMs and distilling that into fast serving models.

New frontier AI models, TypeSafe’s Jev AI, & NASA’s IBM collab

New frontier AI models, TypeSafe’s Jev AI, & NASA’s IBM collab

An exploration of the recent wave of AI innovations, focusing on the pervasive theme of efficiency. The episode delves into cost-reduction in new frontier models like Anthropic's Claude Opus 5.5 and OpenAI's GPT-6, the emergence of TypeSafe AI's "System One" models like Jev for high-speed, calibrated decision-making, and the groundbreaking open-source Lunar Foundation Model by NASA and IBM, showcasing AI's diverse applications beyond text generation.

C++26 for Lazy Programmers • Will Briggs & Todd Montgomery • GOTO 2026

C++26 for Lazy Programmers • Will Briggs & Todd Montgomery • GOTO 2026

Will Briggs and Todd L. Montgomery discuss the impact of AI on programming careers and language learning, the pedagogical approach of Briggs' book "C++26 for Lazy Programmers," and the evolving landscape of C++. They explore how AI requires deeper code fluency, Briggs' method for teaching complex C++ concepts like pointers, and his critiques of C++'s feature proliferation. The conversation concludes with a strong argument for C++'s enduring relevance as a foundational language for aspiring developers.

Runway’s Bet Beyond Video: World Models, Robotics, and the Neural OS — Anastasis Germanidis

Runway’s Bet Beyond Video: World Models, Robotics, and the Neural OS — Anastasis Germanidis

Anastasis Germanidis, co-founder of Runway, discusses the company's journey from early generative creative tools to frontier video models, emphasizing their pivot towards general-purpose world simulation. He details the evolution of Gen-1, Gen-2, and Gen-3 (scaling 10x after Sora's release), highlighting the importance of controllability and the inevitability of real-time generation. The conversation delves into cutting-edge applications like Interface World Models (a fully neural operating system) and World Models for Robotics, where third-person video data and robust simulation are key to training intelligent agents.

← PreviousNext →

Stay In The Loop! Subscribe to Our Newsletter.

Get updates straight to your inbox. No spam, just useful content.