Tokenless

Tokenless

Your AI Agent Starts Every Session Like a New Hire - Killian Carlsen-Phelan, Sonar

Interactive discovery

Explore the topic map

Follow the connections between themes, people, and ideas across the Tokenless archive in an interactive topic modeling map.

Open the map Browse posts

Machine Learning

View All
Judge a Transaction by the Company It Keeps — Somya Rai & MD Sharique, EXL

Judge a Transaction by the Company It Keeps — Somya Rai & MD Sharique, EXL

EXL developed an advanced fraud detection system that augments XGBoost with Graph Neural Network (GNN) embeddings. Traditional tabular models struggle to capture fraud signals residing in transaction neighborhoods. The system's innovative design includes meticulous sampling strategies, disjoint monthly graph construction for leakage control, and a GraphSAGE architecture that aggregates mean, max, and standard deviation of neighbor features to detect subtle fraud patterns. Emphasizing explainability for regulatory compliance and analyst trust, it also features a highly optimized serving architecture achieving 3ms P99 latency, pivoting to edge prediction to reduce cache footprint from 60GB to 2-3GB. This led to a 27-33% relative lift in true positive rates and a projected $65 million incremental fraud capture.

From 15% to 90% GPU Utilization: Fix the Data Pipeline, Not the Model

From 15% to 90% GPU Utilization: Fix the Data Pipeline, Not the Model

Tarun Sunkaraneni from Amazon AGI shows how a multimodal SFT pipeline that spent about 85% of its time waiting on data was brought to roughly 90% GPU utilization. He walks through concurrency with asyncio and Ray actors, prefetching, zero-copy transfer via Ray's object store, and a network-card bottleneck that appears only at scale, and argues that the hardest part of training throughput is often keeping GPUs fed rather than optimizing the model.

Small Models, Big Results: Training a Finance Agent for Under $500 — Charles Dickens, Snorkel AI

Small Models, Big Results: Training a Finance Agent for Under $500 — Charles Dickens, Snorkel AI

Snorkel AI and UC Berkeley's Sky Computing Lab show that a 4B Qwen3 model, trained with reinforcement learning for under $500 using the rLLM framework, beats its 235B sibling on expert-validated financial question answering built from SEC 10-K filings. The talk covers the FinQA dataset construction and verification, common failure modes of frontier models, transfer to multi-table and general tool-use tasks, and ablations showing that simple data and binary rewards outperform more elaborate setups, since the real bottleneck is disciplined tool use rather than reasoning depth.

Artificial Intelligence

View All
How to Decide What Your AI Agent Should Remember - Wojciech Pluta, Oracle

How to Decide What Your AI Agent Should Remember - Wojciech Pluta, Oracle

Wojciech Pluta, head of technical marketing for Oracle AI Database, argues that RAG gives agents a read path while memory gives them a write path, and that the write path is where business value lives. He explains memory promotion, a pipeline that admits, rejects, or escalates candidate memories, and demonstrates it with a mortgage agent that remembers preferences across sessions while refusing unsafe rules. The talk also covers short-term, long-term, and shared memory, why databases are a strong storage layer, and the context card that keeps prompts lean.

Your AI Agent Starts Every Session Like a New Hire - Killian Carlsen-Phelan, Sonar

Your AI Agent Starts Every Session Like a New Hire - Killian Carlsen-Phelan, Sonar

Killian Carlsen-Phelan of Sonar introduces Sonar Vortex, a plugin that gives coding agents a map of a codebase and its guidelines before they write, then deterministically verifies every edit. In a live demo, it catches a temp-file permissions bug that the agent's own tests missed and rejects the agent's first fix.

Please Stop Telling Your AI to “Search Harder”

Please Stop Telling Your AI to “Search Harder”

A discussion of how agent-driven traffic overwhelms APIs, gateways, and cloud infrastructure built for predictable load. It compares microservices with agent workloads, revisits SaaS multi-tenancy, and examines Agent Substrate's actor and worker model for suspend-and-resume agent sessions, with a critical view of whether most users will ever need this layer directly.

Technology

View All
Why Founders Are Betting Big on Factories, Mines, and Energy

Why Founders Are Betting Big on Factories, Mines, and Energy

Erin Price-Wright and Connor Love unpack the AD50 and the rebuilding of America's industrial base, covering how defense demand is financing manufacturing capacity for commercial markets, how AI is reshaping factory economics, how a new generation of founders applies lessons from SpaceX, Tesla, Anduril, and Palantir to mining, energy, and manufacturing, and why private capital is now willing to fund physical infrastructure before government demand is guaranteed.

Mark Cuban’s Plan to Make Healthcare Affordable

Mark Cuban’s Plan to Make Healthcare Affordable

Mark Cuban and Julie Yoo discuss how transparency, direct contracting, and AI could reshape healthcare economics, from Cost Plus Drugs and modular pod manufacturing to personalized medicine, the future of physicians, and advice for founders who want to use AI to learn rather than to stop thinking.

Exploits Now Beat Patches: Open Source Security in the AI Era - Patrick Smyth, Chainguard

Exploits Now Beat Patches: Open Source Security in the AI Era - Patrick Smyth, Chainguard

Patrick Smyth of Chainguard examines how frontier AI has compressed the time between vulnerability disclosure and exploitation, leaving 30-day remediation cycles obsolete. The talk covers AI-assisted attacks, waves of supply chain malware, four attack surfaces spanning malware, known CVEs, zero days, and side doors like CI/CD, developer laptops, and agent skills, and practical defenses including cooldown periods, faster CVE remediation, and signing artifacts with SLSA and Sigstore.

Recent Post

How Supabase Became One Of The Fastest Growing DevTool Companies In The World

How Supabase Became One Of The Fastest Growing DevTool Companies In The World

Supabase CEO Paul Copplestone details how a frustrating Firebase migration sparked an open-source side project that grew into a decacorn. He explains the strategic choice of PostgreSQL and open source, the evolution of developer experience to achieve 5-second time-to-value, and the transformative impact of AI agents, which now launch millions of Supabase databases monthly. The conversation also covers the challenges and advantages of a fully distributed workforce and the future bet on 'self-driving databases' to address the complex 'operate' stage of AI-driven development.

Citation Needed: Provenance for LLM-Built Knowledge Graphs — Daniel Chalef, Zep AI

Citation Needed: Provenance for LLM-Built Knowledge Graphs — Daniel Chalef, Zep AI

Daniel Chalef discusses how LLM synthesis destroys data provenance, making it difficult to trace information back to its sources. He introduces Graphiti, an open-source temporal graph framework, and Zep, an agent memory infrastructure built upon it. This system models provenance as a graph, treating sources as 'episodes' and derived facts as interconnected nodes and edges. This approach enables robust lineage tracing, handles entity merges and fact invalidation through temporal mechanisms, facilitates metadata-driven trust evaluation, and allows for compliant data deletion (e.g., GDPR) based on source support. The benefits include enhanced compliance, improved data veracity, and debuggable AI agents, addressing a critical engineering challenge in LLM applications.

Local Agentic Theory For Mobile Games — Shafik Quoraishee & Joanne Song, The New York Times

Local Agentic Theory For Mobile Games — Shafik Quoraishee & Joanne Song, The New York Times

This presentation explores the innovative concept of running agentic AI entirely on mobile devices to enhance game accessibility and personalization. It delves into the technical challenges of local AI (space, time, energy budgets), contrasts agentic systems with traditional reinforcement learning, and demonstrates practical applications with a Space Invaders agent and a crossword solver. A key takeaway is the transformation of accessibility from fixed toggles to dynamic, real-time adjustments based on player needs, ultimately envisioning a future of billions of small, personalized local AI brains.

Why Agentic Systems Need Ontologies — Frank Coyle, UC Berkeley

Why Agentic Systems Need Ontologies — Frank Coyle, UC Berkeley

Frank Coyle discusses the inherent flaws of purely probabilistic LLMs in agentic systems and proposes a neuro-symbolic solution. He advocates for wrapping LLM tool-use loops with external ontologies and validation mechanisms (like RDFS, OWL, and Pydantic) to provide logical guardrails, preventing common, critical errors that probabilistic reasoning alone cannot reliably avoid.

Learned Execution Graphs for Anomaly Detection & Drift in APIs — Ritvik Pandya, JP Morgan Chase

Learned Execution Graphs for Anomaly Detection & Drift in APIs — Ritvik Pandya, JP Morgan Chase

Ritvik Pandya from JP Morgan introduces 'learn execution graphs'—short-lived DAGs representing API request processing—to detect anomalies and drift in high-throughput systems. This approach localizes performance issues to exact nodes, identifies skipped or reordered steps, and differentiates between transient anomalies and fundamental system drift (structural, volume, or behavioral). It leverages per-client baselines and OpenTelemetry data to reduce mean time to discovery (MTTD) from hours to seconds, enhancing system reliability and observability.

From Systems of Record to Systems of Context — Omri Bruchim, monday.com

From Systems of Record to Systems of Context — Omri Bruchim, monday.com

monday.com introduces a paradigm shift from traditional "systems of record" to a "system of context" to overcome the limitations of current AI agents. By developing a "Monday world model" with a unique data architecture, including slow and fast processing engines inspired by neuroscience and lambda architecture, their AI assistant Sidekick gains a deep understanding of user workflows, priorities, and implicit meaning, allowing it to provide truly contextual and proactive assistance.

← PreviousNext →

Stay In The Loop! Subscribe to Our Newsletter.

Get updates straight to your inbox. No spam, just useful content.