Tokenless

Tokenless

Everyone Has the Same AI Models. Here's What Sets Agents Apart - Richmond Alake, Oracle

Interactive discovery

Explore the topic map

Follow the connections between themes, people, and ideas across the Tokenless archive in an interactive topic modeling map.

Open the map Browse posts

Machine Learning

View All
Judge a Transaction by the Company It Keeps — Somya Rai & MD Sharique, EXL

Judge a Transaction by the Company It Keeps — Somya Rai & MD Sharique, EXL

EXL developed an advanced fraud detection system that augments XGBoost with Graph Neural Network (GNN) embeddings. Traditional tabular models struggle to capture fraud signals residing in transaction neighborhoods. The system's innovative design includes meticulous sampling strategies, disjoint monthly graph construction for leakage control, and a GraphSAGE architecture that aggregates mean, max, and standard deviation of neighbor features to detect subtle fraud patterns. Emphasizing explainability for regulatory compliance and analyst trust, it also features a highly optimized serving architecture achieving 3ms P99 latency, pivoting to edge prediction to reduce cache footprint from 60GB to 2-3GB. This led to a 27-33% relative lift in true positive rates and a projected $65 million incremental fraud capture.

From 15% to 90% GPU Utilization: Fix the Data Pipeline, Not the Model

From 15% to 90% GPU Utilization: Fix the Data Pipeline, Not the Model

Tarun Sunkaraneni from Amazon AGI shows how a multimodal SFT pipeline that spent about 85% of its time waiting on data was brought to roughly 90% GPU utilization. He walks through concurrency with asyncio and Ray actors, prefetching, zero-copy transfer via Ray's object store, and a network-card bottleneck that appears only at scale, and argues that the hardest part of training throughput is often keeping GPUs fed rather than optimizing the model.

Small Models, Big Results: Training a Finance Agent for Under $500 — Charles Dickens, Snorkel AI

Small Models, Big Results: Training a Finance Agent for Under $500 — Charles Dickens, Snorkel AI

Snorkel AI and UC Berkeley's Sky Computing Lab show that a 4B Qwen3 model, trained with reinforcement learning for under $500 using the rLLM framework, beats its 235B sibling on expert-validated financial question answering built from SEC 10-K filings. The talk covers the FinQA dataset construction and verification, common failure modes of frontier models, transfer to multi-table and general tool-use tasks, and ablations showing that simple data and binary rewards outperform more elaborate setups, since the real bottleneck is disciplined tool use rather than reasoning depth.

Artificial Intelligence

View All
Everyone Has the Same AI Models. Here's What Sets Agents Apart - Richmond Alake, Oracle

Everyone Has the Same AI Models. Here's What Sets Agents Apart - Richmond Alake, Oracle

Richmond Alake argues that after the control plane, agent architectures need an intelligence plane covering what an agent knows, remembers, is allowed to see, and how it improves. He draws on the WWII Midway codebreaking story to separate information from intelligence, then demos a governed agent using an ontology and semantic layer that answers correctly about 99% of the time with far fewer tokens than a naive agent. The talk also covers Oracle's agent memory package, deep data security, private inference, and fine-tuned decision models for memory routing.

Using Agents for Long-Horizon Financial Work — Aman Singh, Arca

Using Agents for Long-Horizon Financial Work — Aman Singh, Arca

Aman Singh, head of AI at Arca, explains how the firm is building an AI-native wealth management business in which agents run back-office work, monitor clients proactively, and coordinate multi-day workflows, while humans retain advisory relationships and trade execution. The discussion covers model selection through internal benchmarks, a model-agnostic custom harness with tiered routing, persistent memory for long-running tasks, deterministic and LLM-based guardrails, auditability by default, decision models for financial accuracy, and feedback loops that turn staff edits into evals.

THE $800B COMPUTE TRAP

THE $800B COMPUTE TRAP

Ben Lorica and Evangelos Simoudis work through Anthropic's S-1 filing, weighing its striking growth and improving unit economics against compute commitments, falling prices from open-weight models, and dependence on coding. They then examine SpaceX's emerging neocloud business and close with a debate over proposed frontier AI regulation, from self-improvement limits to independent testing and incident disclosure.

Technology

View All
Why Founders Are Betting Big on Factories, Mines, and Energy

Why Founders Are Betting Big on Factories, Mines, and Energy

Erin Price-Wright and Connor Love unpack the AD50 and the rebuilding of America's industrial base, covering how defense demand is financing manufacturing capacity for commercial markets, how AI is reshaping factory economics, how a new generation of founders applies lessons from SpaceX, Tesla, Anduril, and Palantir to mining, energy, and manufacturing, and why private capital is now willing to fund physical infrastructure before government demand is guaranteed.

Mark Cuban’s Plan to Make Healthcare Affordable

Mark Cuban’s Plan to Make Healthcare Affordable

Mark Cuban and Julie Yoo discuss how transparency, direct contracting, and AI could reshape healthcare economics, from Cost Plus Drugs and modular pod manufacturing to personalized medicine, the future of physicians, and advice for founders who want to use AI to learn rather than to stop thinking.

Exploits Now Beat Patches: Open Source Security in the AI Era - Patrick Smyth, Chainguard

Exploits Now Beat Patches: Open Source Security in the AI Era - Patrick Smyth, Chainguard

Patrick Smyth of Chainguard examines how frontier AI has compressed the time between vulnerability disclosure and exploitation, leaving 30-day remediation cycles obsolete. The talk covers AI-assisted attacks, waves of supply chain malware, four attack surfaces spanning malware, known CVEs, zero days, and side doors like CI/CD, developer laptops, and agent skills, and practical defenses including cooldown periods, faster CVE remediation, and signing artifacts with SLSA and Sigstore.

Recent Post

Building an Autonomous Engineering Org - Angie Jones, Agentic AI Foundation

Building an Autonomous Engineering Org - Angie Jones, Agentic AI Foundation

Angie Jones details Block's journey in transforming its engineering organization into an autonomous one using AI agents. She outlines a five-stage AI maturity model, the strategic implementation of an 'AI Champions' program, and the technical steps taken to make repositories AI-ready and enable seamless agent delegation directly within developer workflows. The talk covers challenges in scaling multi-agent parallelism, including code review bottlenecks and resource management, and the development of an orchestrator ('Builder Bot') and 'Company World Model' to achieve full autonomy. It concludes with a critical reflection on the ethical implications of achieving such high levels of AI-driven automation.

Turbocharge Your Agent's Retrieval with TurboQuant - Shashi Jagtap, Superagentic AI

Turbocharge Your Agent's Retrieval with TurboQuant - Shashi Jagtap, Superagentic AI

This talk introduces TurboQuant, a training-free compression method from Google Research that reduces embedding memory footprint by 5x (from 32-bit to 3-4 bits) without losing search quality. It details how TurboQuant works through scalar quantization and a crucial one-bit error correction step, QJL, enabling agents to remember more on existing hardware by optimizing both KV cache and RAG vector stores. A live demo showcases its effectiveness, making it a vendor-neutral solution for efficient AI agent retrieval.

Using Spec-Driven Development for Production Workflows - Erik Hanchett, AWS

Using Spec-Driven Development for Production Workflows - Erik Hanchett, AWS

Erik Hanchett discusses spec-driven development (SDD) as a structured approach to building complex software features with AI coding assistants. He explains how to guide AI "interns" through distinct phases of requirements, design, and implementation, emphasizing context management, the use of "skills," and the crucial role of the human in the loop for review. Hanchett highlights AWS's Kiro tool, which automates much of this process, and the Model Context Protocol (MCP) for integrating external data sources, offering a pathway to higher-quality code and more effective AI collaboration.

The 100-Tool Agent Is a Trap - Sohail Shaikh & Ankush Rastogi, Prosodica

The 100-Tool Agent Is a Trap - Sohail Shaikh & Ankush Rastogi, Prosodica

This session unveils the "Fat Agent" trap in LLM agent architectures, where loading an entire tool catalog into the system prompt causes severe latency, cost, and accuracy problems. It presents the Semantic Tool Router pattern, a practical solution leveraging Just-in-Time Context Injection and vector search (RAG for tools) to dynamically provide only relevant tools, dramatically reducing prompt size, enhancing performance, and improving reliability across frontier models like GPT-4o and Gemini 2.0.

OpenAI Codex lead on the new shape of product work | Andrew Ambrosino

OpenAI Codex lead on the new shape of product work | Andrew Ambrosino

Andrew Ambrosino, Product and Engineering Lead for the Codex app at OpenAI, details how AI is transforming product development, shifting focus from implementation to curation and the crucial role of "taste." He discusses AI's current limitations in design, the evolving nature of product roles, and OpenAI's "zone defense" approach to product management. Ambrosino shares his personal workflow with Codex and outlines the vision for it as an intelligent "home base" that orchestrates work across various applications, exemplified by a story of Codex building a Premiere Pro extension.

The Promptware Kill Chain: How Prompt Injection Becomes AI Malware

The Promptware Kill Chain: How Prompt Injection Becomes AI Malware

Promptware introduces a new class of AI malware leveraging prompt injections to exploit architectural flaws in LLMs. This summary details The Promptware Kill Chain, covering stages from initial access and jailbreaking to persistence, lateral movement, and real-world impact. It emphasizes the critical need for a Zero Trust approach, treating AI agents as hostile runtimes to defend against these sophisticated AI-native threats.

← PreviousNext →

Stay In The Loop! Subscribe to Our Newsletter.

Get updates straight to your inbox. No spam, just useful content.