Tokenless

Tokenless

Open Source Security in the Age of AI

Interactive discovery

Explore the topic map

Follow the connections between themes, people, and ideas across the Tokenless archive in an interactive topic modeling map.

Open the map Browse posts

Machine Learning

View All
Judge a Transaction by the Company It Keeps — Somya Rai & MD Sharique, EXL

Judge a Transaction by the Company It Keeps — Somya Rai & MD Sharique, EXL

EXL developed an advanced fraud detection system that augments XGBoost with Graph Neural Network (GNN) embeddings. Traditional tabular models struggle to capture fraud signals residing in transaction neighborhoods. The system's innovative design includes meticulous sampling strategies, disjoint monthly graph construction for leakage control, and a GraphSAGE architecture that aggregates mean, max, and standard deviation of neighbor features to detect subtle fraud patterns. Emphasizing explainability for regulatory compliance and analyst trust, it also features a highly optimized serving architecture achieving 3ms P99 latency, pivoting to edge prediction to reduce cache footprint from 60GB to 2-3GB. This led to a 27-33% relative lift in true positive rates and a projected $65 million incremental fraud capture.

From 15% to 90% GPU Utilization: Fix the Data Pipeline, Not the Model

From 15% to 90% GPU Utilization: Fix the Data Pipeline, Not the Model

Tarun Sunkaraneni from Amazon AGI shows how a multimodal SFT pipeline that spent about 85% of its time waiting on data was brought to roughly 90% GPU utilization. He walks through concurrency with asyncio and Ray actors, prefetching, zero-copy transfer via Ray's object store, and a network-card bottleneck that appears only at scale, and argues that the hardest part of training throughput is often keeping GPUs fed rather than optimizing the model.

Small Models, Big Results: Training a Finance Agent for Under $500 — Charles Dickens, Snorkel AI

Small Models, Big Results: Training a Finance Agent for Under $500 — Charles Dickens, Snorkel AI

Snorkel AI and UC Berkeley's Sky Computing Lab show that a 4B Qwen3 model, trained with reinforcement learning for under $500 using the rLLM framework, beats its 235B sibling on expert-validated financial question answering built from SEC 10-K filings. The talk covers the FinQA dataset construction and verification, common failure modes of frontier models, transfer to multi-table and general tool-use tasks, and ablations showing that simple data and binary rewards outperform more elaborate setups, since the real bottleneck is disciplined tool use rather than reasoning depth.

Artificial Intelligence

View All
We Kept Rebuilding Our AI Agent. Here's What Survived - Fuad Ali, Arize AI

We Kept Rebuilding Our AI Agent. Here's What Survived - Fuad Ali, Arize AI

Arize's in-product agent Alex went from a 2023 prototype to a single harness-driven agent with planning, memory, and on-demand skills. AI PM Fuad Ali walks through the decisions behind each change, including moving the plan into the harness, making finish an explicit gate, treating large tool results like files, using one small memory file per user instead of vector stores or knowledge graphs, merging specialists into one agent, and using production sessions as tests.

Stop Giving Your Agent Tools. Give It a Sandbox - Mikyo King, Arize AI

Stop Giving Your Agent Tools. Give It a Sandbox - Mikyo King, Arize AI

Mikyo King, head of open source at Arize AI, explains code mode, an agent architecture where the model searches for tools and composes them in a sandboxed programming environment instead of loading large tool catalogs into context. He covers why it works, how Arize built it into Phoenix with Bash, Python, SQL, and UI control, its hidden costs around secrets, permissions, durability, and double sandboxing, and Harbor evals showing 43% fewer tokens and 31% lower cost.

What a $900M Bank Error Teaches Us About AI Agents - John Feminella, Two Sigma

What a $900M Bank Error Teaches Us About AI Agents - John Feminella, Two Sigma

John Feminella of Two Sigma uses a 2020 Citibank payment error to show how AI agents can be given real autonomy through five composable controls: an agent registry, risk-based review, purpose-scoped tool access, shared evals, and classifiers that send humans only the approvals that matter.

Technology

View All
Exploits Now Beat Patches: Open Source Security in the AI Era - Patrick Smyth, Chainguard

Exploits Now Beat Patches: Open Source Security in the AI Era - Patrick Smyth, Chainguard

Patrick Smyth of Chainguard examines how frontier AI has compressed the time between vulnerability disclosure and exploitation, leaving 30-day remediation cycles obsolete. The talk covers AI-assisted attacks, waves of supply chain malware, four attack surfaces spanning malware, known CVEs, zero days, and side doors like CI/CD, developer laptops, and agent skills, and practical defenses including cooldown periods, faster CVE remediation, and signing artifacts with SLSA and Sigstore.

Can Your AI Heat My House?

Can Your AI Heat My House?

A wide-ranging conversation on how AI inference is pushing cloud infrastructure, data centers, and hardware supply chains against physical limits, covering the rise of alt clouds, rack density and cooling, hardware lifecycles and circularity, talent shortages, heat reuse for communities, and what engineering leaders can do about resource-aware software.

What will computer chips look like in 2045?

What will computer chips look like in 2045?

Intel's leadership walks through how advanced process nodes are brought to volume, from yield learning and the lessons of 10nm to the shift from planar transistors to gate-all-around, High-NA EUV, backside power, and CFET. The discussion widens to the chip-to-chip bottleneck that hybrid bonding targets, the supply limits on EUV tooling as AI compute demand grows, and the economics that make foundry scale decisive.

Recent Post

Building Cyber Defense for the Agentic Era

Building Cyber Defense for the Agentic Era

Kevin Mandia, founder of Mandiant and CEO of Armadin, discusses how AI is revolutionizing cybersecurity. He explains that machine-speed attacks necessitate autonomous defenses, detailing Armadin's approach of continuous AI-driven red teaming to find zero-days and build real-time defense mechanisms. The conversation also explores the transformation of the SOC, the demise of traditional pentesting, and the challenges of building a company at AI speed.

How AI Agents Pay: Checkout in ChatGPT and Google AI Mode — Sam Parsons, PayPal

How AI Agents Pay: Checkout in ChatGPT and Google AI Mode — Sam Parsons, PayPal

Sam Parsons from PayPal Enterprise Payments explores three distinct ways merchants can accept payments initiated by AI agents: Instant Checkout in ChatGPT (Agentic Commerce Protocol), Google AI Mode (Universal Commerce Protocol), and a custom MCP app with an external checkout page. He details the technical flows, emphasizing tokenization for secure transactions and outlining the trade-offs between in-agent experiences and full merchant control.

Advanced Workshop: Mastering AI Observability — Doug Guthrie, Braintrust

Advanced Workshop: Mastering AI Observability — Doug Guthrie, Braintrust

Doug Guthrie showcases how Braintrust connects observability with AI agent improvement. Using a support agent, he demonstrates setting up tracing, establishing evaluation baselines, and publishing custom scorers. The workshop delves into Braintrust's Topics feature for discovering unknown failure modes, configuring online automations, and importing real-world traces. A key focus is on automating the improvement cycle: using the Loop assistant for SQL-based trace analysis, integrating coding agents with Braintrust CLI skills to propose code changes, add regressions, run evals, and generate pull requests, thereby closing the feedback loop from production to development.

What Is an Inference Engine, Anyway? — Charles Frye, Modal

What Is an Inference Engine, Anyway? — Charles Frye, Modal

Charles Frye explains the architecture, performance engineering, and operational challenges of LLM inference engines. He dissects workload types, core components like schedulers and kernel backends, and advanced techniques such as KV caching, CUDA graphs, and speculative decoding, concluding with essential strategies for observability and debugging in production environments.

Your LLM Judge Is a Confident Liar: Building Better Verifiers — Browserbase

Your LLM Judge Is a Confident Liar: Building Better Verifiers — Browserbase

Browserbase and Microsoft Research unveil their Universal Verifier for computer-use and web agents, addressing the critical flaw of inaccurate LLM-as-judge benchmarks that yield "confident liars." They detail its four guiding principles, demonstrating how it drastically cuts false positives and provides high agreement with human evaluations, leading to better training data. An auto-research experiment highlights the synergy between AI and human expertise in developing robust evaluation systems.

From Raw Documents to AI-Ready Data — Leo Platzer & Jeff Koss

From Raw Documents to AI-Ready Data — Leo Platzer & Jeff Koss

This presentation by Jeff Koss and Leo Platzer from Deasy Labs (now Collibra) tackles the critical challenge of scaling AI chatbots from pilot projects to production with large, messy unstructured datasets. They demonstrate a solution for curating and cleaning 80,000+ SharePoint documents, highlighting the importance of data quality—specifically identifying duplicates, conflicts, sensitive information, and ensuring data freshness—to significantly improve RAG chatbot performance and reduce development time.

← PreviousNext →

Stay In The Loop! Subscribe to Our Newsletter.

Get updates straight to your inbox. No spam, just useful content.