Tokenless

Tokenless

How Revolut Cut AI Coding Costs 90% With Self-Hosted Open Models - David Abitbol, Revolut

Interactive discovery

Explore the topic map

Follow the connections between themes, people, and ideas across the Tokenless archive in an interactive topic modeling map.

Open the map Browse posts

Machine Learning

View All
Judge a Transaction by the Company It Keeps — Somya Rai & MD Sharique, EXL

Judge a Transaction by the Company It Keeps — Somya Rai & MD Sharique, EXL

EXL developed an advanced fraud detection system that augments XGBoost with Graph Neural Network (GNN) embeddings. Traditional tabular models struggle to capture fraud signals residing in transaction neighborhoods. The system's innovative design includes meticulous sampling strategies, disjoint monthly graph construction for leakage control, and a GraphSAGE architecture that aggregates mean, max, and standard deviation of neighbor features to detect subtle fraud patterns. Emphasizing explainability for regulatory compliance and analyst trust, it also features a highly optimized serving architecture achieving 3ms P99 latency, pivoting to edge prediction to reduce cache footprint from 60GB to 2-3GB. This led to a 27-33% relative lift in true positive rates and a projected $65 million incremental fraud capture.

From 15% to 90% GPU Utilization: Fix the Data Pipeline, Not the Model

From 15% to 90% GPU Utilization: Fix the Data Pipeline, Not the Model

Tarun Sunkaraneni from Amazon AGI shows how a multimodal SFT pipeline that spent about 85% of its time waiting on data was brought to roughly 90% GPU utilization. He walks through concurrency with asyncio and Ray actors, prefetching, zero-copy transfer via Ray's object store, and a network-card bottleneck that appears only at scale, and argues that the hardest part of training throughput is often keeping GPUs fed rather than optimizing the model.

Small Models, Big Results: Training a Finance Agent for Under $500 — Charles Dickens, Snorkel AI

Small Models, Big Results: Training a Finance Agent for Under $500 — Charles Dickens, Snorkel AI

Snorkel AI and UC Berkeley's Sky Computing Lab show that a 4B Qwen3 model, trained with reinforcement learning for under $500 using the rLLM framework, beats its 235B sibling on expert-validated financial question answering built from SEC 10-K filings. The talk covers the FinQA dataset construction and verification, common failure modes of frontier models, transfer to multi-table and general tool-use tasks, and ablations showing that simple data and binary rewards outperform more elaborate setups, since the real bottleneck is disciplined tool use rather than reasoning depth.

Artificial Intelligence

View All
How Revolut Cut AI Coding Costs 90% With Self-Hosted Open Models - David Abitbol, Revolut

How Revolut Cut AI Coding Costs 90% With Self-Hosted Open Models - David Abitbol, Revolut

David Abitbol, who leads AI operations at Revolut, shares what AI tools did to 2,000 engineers' coding time and lead time. The main finding is that self-hosting open-source GLM models delivered about 60-70% faster delivery at roughly a tenth of frontier-lab costs. He covers the GPU sizing, latency targets, tuning that made the same hardware 88% faster, and how an EU-regulated bank keeps the setup compliant.

Grokking Software Architecture • Matt Erman & Luca Mezzalira • GOTO 2026

Grokking Software Architecture • Matt Erman & Luca Mezzalira • GOTO 2026

Matt Erman, author of Grokking Software Architecture, joins Luca Mezzalira to discuss why engineering fundamentals matter more in the AI era, how architects can act as clarity engineers, a five-step architectural thinking process, Architecture Decision Records, and the risks of letting AI generate systems without human judgment.

We Trust AI Agents That Break Every Day - Shy Ruparel, Temporal

We Trust AI Agents That Break Every Day - Shy Ruparel, Temporal

Shy Ruparel of Temporal breaks down the four gaps keeping AI agents from production, drawing on survey data from 554 engineers, and demos a crash-resilient $2,500 payout workflow built on durable execution with a local model.

Technology

View All
Mark Cuban’s Plan to Make Healthcare Affordable

Mark Cuban’s Plan to Make Healthcare Affordable

Mark Cuban and Julie Yoo discuss how transparency, direct contracting, and AI could reshape healthcare economics, from Cost Plus Drugs and modular pod manufacturing to personalized medicine, the future of physicians, and advice for founders who want to use AI to learn rather than to stop thinking.

Exploits Now Beat Patches: Open Source Security in the AI Era - Patrick Smyth, Chainguard

Exploits Now Beat Patches: Open Source Security in the AI Era - Patrick Smyth, Chainguard

Patrick Smyth of Chainguard examines how frontier AI has compressed the time between vulnerability disclosure and exploitation, leaving 30-day remediation cycles obsolete. The talk covers AI-assisted attacks, waves of supply chain malware, four attack surfaces spanning malware, known CVEs, zero days, and side doors like CI/CD, developer laptops, and agent skills, and practical defenses including cooldown periods, faster CVE remediation, and signing artifacts with SLSA and Sigstore.

Can Your AI Heat My House?

Can Your AI Heat My House?

A wide-ranging conversation on how AI inference is pushing cloud infrastructure, data centers, and hardware supply chains against physical limits, covering the rise of alt clouds, rack density and cooling, hardware lifecycles and circularity, talent shortages, heat reuse for communities, and what engineering leaders can do about resource-aware software.

Recent Post

🔬 The Physical World Is More Forgiving Than You Think — Anima Anandkumar, Caltech

🔬 The Physical World Is More Forgiving Than You Think — Anima Anandkumar, Caltech

Anima Anandkumar discusses her vision for AI in science, moving beyond language models to apply machine learning to the physical world. She introduces neural operators, especially Fourier neural operators, as a solution to data scarcity and resolution challenges in domains like weather, climate, and fusion. These models integrate physical constraints and data to achieve unprecedented speed and accuracy, even on consumer hardware, enabling capabilities from early hurricane prediction to digital twins for fusion reactors and inverse design for advanced materials. The conversation highlights the need for principled AI design for scientific discovery and advocates for distinct regulatory approaches for AI in science.

Knowledge Systems: The New GTM Stack — Jeffrey Wang, Exa

Knowledge Systems: The New GTM Stack — Jeffrey Wang, Exa

Jeffrey Wang, co-founder of Exa, details how "go to market" (GTM) is transforming into an AI engineering problem. He showcases Exa's agent-first approach, using tools like an ICP dashboard for market intelligence and a personal AI clone (Jeffbot) to automate and optimize sales, emphasizing the need for robust APIs and arbitrarily customizable systems in this new AI-driven landscape.

The mathematics of AI uncertainty

The mathematics of AI uncertainty

Zoubin Ghahramani, a leading researcher at Google DeepMind and professor at Cambridge, argues that incorporating uncertainty is a missing piece for ever-improving AI. He discusses the critical difference between correctness and confidence in AI, tracing the historical evolution of probabilistic models from early neural networks to modern Bayesian approaches. Ghahramani highlights how current large language models often 'fake' uncertainty and explores successful implementations in areas like weather forecasting and AlphaFold, ultimately advocating for architectural innovations over pure scale to build more robust, trustworthy, and human-aligned intelligent systems that understand their own limitations.

The State of AI: Models, Moats, and the Consumer Renaissance

The State of AI: Models, Moats, and the Consumer Renaissance

Anish Acharya and Jen Kha delve into the evolving AI landscape, dissecting the model layer with its emerging multiple winners and the strategic choice between frontier and open-weight models. They explore how the application layer captures value through model aggregation and specialization, ultimately ushering in a renaissance for consumer AI with personal agents, coding tools, and new economic models, urging founders to think big.

AI in GTM at Notion — Flora Liu

AI in GTM at Notion — Flora Liu

Flora Liu from Notion's GTM engineering team discusses transforming a fragmented Go-to-Market system into a unified, agent-driven platform. She details how Notion tackles challenges like dispersed customer data and unstructured insights by building a four-layered architecture (Know, Decide, Act, Learn) where humans and AI agents operate on the same substrate, leveraging Snowflake, DynamoDB, and Notion itself to create durable, self-improving workflows and boost sales and marketing effectiveness.

Platform Engineering for Developers, Architects & the Rest of Us • Daniel Bryant • GOTO 2025

Platform Engineering for Developers, Architects & the Rest of Us • Daniel Bryant • GOTO 2025

Daniel Bryant discusses platform engineering for software developers and architects, emphasizing treating platforms as internal products with developers as customers. He outlines a three-layered architecture, the evolution from monolithic systems to microservices, and the importance of 'golden bricks' over 'golden paths' for composability. Key takeaways include API-first design, minimizing cognitive load, avoiding leaky abstractions, and measuring success through frameworks like DORA and DevEx to achieve speed, safety, and scale.

← PreviousNext →

Stay In The Loop! Subscribe to Our Newsletter.

Get updates straight to your inbox. No spam, just useful content.