Tokenless

Tokenless

AI That Hunts Logic Bugs Before Attackers Do - Taylor Luttrell-Williams, Sonar

Interactive discovery

Explore the topic map

Follow the connections between themes, people, and ideas across the Tokenless archive in an interactive topic modeling map.

Open the map Browse posts

Machine Learning

View All
Judge a Transaction by the Company It Keeps — Somya Rai & MD Sharique, EXL

Judge a Transaction by the Company It Keeps — Somya Rai & MD Sharique, EXL

EXL developed an advanced fraud detection system that augments XGBoost with Graph Neural Network (GNN) embeddings. Traditional tabular models struggle to capture fraud signals residing in transaction neighborhoods. The system's innovative design includes meticulous sampling strategies, disjoint monthly graph construction for leakage control, and a GraphSAGE architecture that aggregates mean, max, and standard deviation of neighbor features to detect subtle fraud patterns. Emphasizing explainability for regulatory compliance and analyst trust, it also features a highly optimized serving architecture achieving 3ms P99 latency, pivoting to edge prediction to reduce cache footprint from 60GB to 2-3GB. This led to a 27-33% relative lift in true positive rates and a projected $65 million incremental fraud capture.

From 15% to 90% GPU Utilization: Fix the Data Pipeline, Not the Model

From 15% to 90% GPU Utilization: Fix the Data Pipeline, Not the Model

Tarun Sunkaraneni from Amazon AGI shows how a multimodal SFT pipeline that spent about 85% of its time waiting on data was brought to roughly 90% GPU utilization. He walks through concurrency with asyncio and Ray actors, prefetching, zero-copy transfer via Ray's object store, and a network-card bottleneck that appears only at scale, and argues that the hardest part of training throughput is often keeping GPUs fed rather than optimizing the model.

Small Models, Big Results: Training a Finance Agent for Under $500 — Charles Dickens, Snorkel AI

Small Models, Big Results: Training a Finance Agent for Under $500 — Charles Dickens, Snorkel AI

Snorkel AI and UC Berkeley's Sky Computing Lab show that a 4B Qwen3 model, trained with reinforcement learning for under $500 using the rLLM framework, beats its 235B sibling on expert-validated financial question answering built from SEC 10-K filings. The talk covers the FinQA dataset construction and verification, common failure modes of frontier models, transfer to multi-table and general tool-use tasks, and ablations showing that simple data and binary rewards outperform more elaborate setups, since the real bottleneck is disciplined tool use rather than reasoning depth.

Artificial Intelligence

View All
AI That Hunts Logic Bugs Before Attackers Do - Taylor Luttrell-Williams, Sonar

AI That Hunts Logic Bugs Before Attackers Do - Taylor Luttrell-Williams, Sonar

Sonar's Taylor Luttrell-Williams introduces SonarQube Hunter Agent, an AI security agent that finds intent-level flaws such as broken access control, business logic gaps, and authentication holes that pattern-based SAST cannot detect. The talk covers its multi-agent pipeline with adversarial validation, Sonar's join to the OpenAI Daybreak Cyber Partner Program, and a live demo that surfaced 46 issues in a Python app, including a self-promotion to admin and an MFA bypass.

The PHP bug threatening the web. Plus, who's auditing AI?

The PHP bug threatening the web. Plus, who's auditing AI?

Security Intelligence panelists Nick, Don and Jim unpack three stories: two decades-old PHP flaws (PHP2Shell) that let attackers take over servers without logging in and were found by AI before patches landed, Anthropic's decision to give outside evaluators employee-like access and whether rival frontier labs should audit each other, and 333 Tor exit relays hijacked through a reused password. The discussion centers on visibility, patching under legacy constraints, secure by design, and the limits of trust in AI and anonymity networks.

Velocity Through Rigour: Then & Now • Cate Huston • Bug Bash EU 2026

Velocity Through Rigour: Then & Now • Cate Huston • Bug Bash EU 2026

Cate Huston, CTO at Twill and author of The Engineering Leader, shares how she rebuilt a no-code product into a production platform with a two-person team and agents, and argues that the management playbook for scaling people still applies to scaling AI agents. She covers the shift from f(n) to f(n × a) team scaling, the four management layers, guardrails and the roughly 30 percent of output she believes they require, shift-left practices, CI as a cost and quality lever, and why rigour is what turns speed into lasting velocity.

Technology

View All
Mark Cuban’s Plan to Make Healthcare Affordable

Mark Cuban’s Plan to Make Healthcare Affordable

Mark Cuban and Julie Yoo discuss how transparency, direct contracting, and AI could reshape healthcare economics, from Cost Plus Drugs and modular pod manufacturing to personalized medicine, the future of physicians, and advice for founders who want to use AI to learn rather than to stop thinking.

Exploits Now Beat Patches: Open Source Security in the AI Era - Patrick Smyth, Chainguard

Exploits Now Beat Patches: Open Source Security in the AI Era - Patrick Smyth, Chainguard

Patrick Smyth of Chainguard examines how frontier AI has compressed the time between vulnerability disclosure and exploitation, leaving 30-day remediation cycles obsolete. The talk covers AI-assisted attacks, waves of supply chain malware, four attack surfaces spanning malware, known CVEs, zero days, and side doors like CI/CD, developer laptops, and agent skills, and practical defenses including cooldown periods, faster CVE remediation, and signing artifacts with SLSA and Sigstore.

Can Your AI Heat My House?

Can Your AI Heat My House?

A wide-ranging conversation on how AI inference is pushing cloud infrastructure, data centers, and hardware supply chains against physical limits, covering the rise of alt clouds, rack density and cooling, hardware lifecycles and circularity, talent shortages, heat reuse for communities, and what engineering leaders can do about resource-aware software.

Recent Post

Large clusters for small models — Daniel Svonava, Superlinked

Large clusters for small models — Daniel Svonava, Superlinked

Daniel Svonava argues that small open-source models, when specialized and properly served, can achieve frontier performance for specific tasks, offering significant cost savings and latency improvements over large, generalized models or managed endpoints. He highlights challenges with existing serving infrastructure for a fleet of diverse small models and introduces Superlinked's open-source solution, which leverages a pull-based, centralized queuing system, a Rust sidecar for runtime abstraction, and an autoresearch loop for automated model tuning, enabling high throughput (e.g., half a million embedding tokens/sec on one GPU) and efficient deployment of specialized models and LoRAs.

What's New in Inference Engineering — Philip Kiely, Baseten

What's New in Inference Engineering — Philip Kiely, Baseten

Philip Kiely provides an update on recent advancements in inference engineering, covering new techniques in quantization (TurboQuant's specific application), KV cache compaction (introducing 'Still' for learned, compressed memory), and speculative decoding (from Eagle 3 to Dlash and DSpark, including continuous retraining). He emphasizes the blurring lines between training and inference and differentiates between local and data center optimization strategies.

Routing LLM Inference in Production: From Engine Signals to Policy — Qianru Lao & Lu Zhang, OpenAI

Routing LLM Inference in Production: From Engine Signals to Policy — Qianru Lao & Lu Zhang, OpenAI

This talk outlines OpenAI's journey in building a robust inference load balancer. It details the transition from an initial feedback-loop-driven system, which suffered from explainability issues and disruptive oscillations, to a sophisticated control plane/data plane architecture. The new system leverages a global view to optimize end-to-end latency across all traffic, balancing network distance with engine-side queuing, and includes critical protection mechanisms like outlier penalties, dynamic retry budgets, and load shedding to ensure stability in production.

Operating Distributed Inference Systems at Scale — Nishant Gupta & Naman Ahuja, Meta

Operating Distributed Inference Systems at Scale — Nishant Gupta & Naman Ahuja, Meta

Meta's Nishant Gupta and Naman Ahuja explain how AI inference, the company's fastest-growing workload, requires a dedicated orchestration layer akin to Kubernetes for virtual machines. They detail the unique challenges of LLM serving compared to traditional microservices, emphasizing the intricate coupling of infrastructure layers, the distributed transaction nature of requests, and a seven-axis framework for scheduling. The talk concludes with the imperative to optimize for "cost per successful task" and the necessity of an inference-specific control plane to manage the complex interplay of latency, cost, and throughput.

A Worm With 302 Neurons Inspired Their Architecture — Ramin Hasani, Liquid AI

A Worm With 302 Neurons Inspired Their Architecture — Ramin Hasani, Liquid AI

Liquid AI began by drawing inspiration from the C. elegans worm to develop Liquid Neural Networks, focusing on continuous-time, differentiable systems for efficient intelligence. Facing scaling challenges, they developed STAR, a meta-AI system for architectural search, optimizing hybrid models for quality, memory, latency, and speed, leading to their Liquid Foundation Models (LFMs). Their core focus is on bringing AI to the edge (on-device, in-car) for cost reduction, privacy, and offline capabilities, with successful deployments at Mercedes-Benz and Shopify. Liquid is also building a platform for 'sovereign AI,' enabling enterprises to customize and own their intelligence end-to-end, and researching massively multimodal systems, efficiency across the AI stack, and novel data types like DNA.

Databricks CEO: Stop Scaring People About AI

Databricks CEO: Stop Scaring People About AI

Databricks CEO Ali Ghodsi discusses the current state of AI, arguing against existential risk alarmism and advocating for a focus on immediate threats like AI-powered cyberattacks. He provides a rigorous definition for recursive self-improvement and explains how building an organizational 'ontology' can unlock massive productivity gains in enterprises. Ghodsi also covers the shift to multi-model AI strategies and cost management, highlighting how infrastructure is evolving to support agentic systems.

← PreviousNext →

Stay In The Loop! Subscribe to Our Newsletter.

Get updates straight to your inbox. No spam, just useful content.