Tokenless

Tokenless

AI-Native Organisations Run on Skills: How to Structure and Scale Them — Imad Touil, QuantumBlack

Interactive discovery

Explore the topic map

Follow the connections between themes, people, and ideas across the Tokenless archive in an interactive topic modeling map.

Open the map Browse posts

Machine Learning

View All
Invited Research Talk: Measuring Generalization in EEG Foundation Models

Invited Research Talk: Measuring Generalization in EEG Foundation Models

This talk presents a multi-dimensional evaluation and interpretability framework for EEG foundation models. It reveals that current models often fail to outperform supervised baselines for BCI tasks, lack robustness to sparse channels, and exhibit an aperiodic low-frequency bias, making them better at capturing subject-specific rather than task-specific information. The analysis highlights critical deficiencies and suggests future directions for pre-training objectives and data collection to improve generalization.

Can LLMs Write Fast Multi-GPU Kernels? — Simran Arora, Together AI

Can LLMs Write Fast Multi-GPU Kernels? — Simran Arora, Together AI

Simran Arora discusses the critical bottleneck shift in large AI workloads from GPU compute to inter-GPU communication. Her team's solution, ParallelKittens, offers a set of primitives to optimize multi-GPU kernels by leveraging fundamental transfer mechanisms and compute-communication overlapping. They introduce ParallelKernelBench, a benchmark to evaluate AI models' ability to generate such kernels, revealing that while models can handle syntax, they struggle with deeper reasoning about communication patterns and hardware trade-offs.

PhylaFlow: Hybrid flow matching in phylogenetic tree space

PhylaFlow: Hybrid flow matching in phylogenetic tree space

PhylaFlow is a hybrid flow-matching framework that navigates Billera–Holmes–Vogtmann (BHV) tree space to accelerate Bayesian phylogenetic inference. By learning geodesic paths from random trees to posterior samples, PhylaFlow efficiently initializes MCMC chains, drastically reducing the "burn-in" time. A PhylaFlow-MCMC variant, which guides MrBayes move acceptance, significantly outperforms traditional methods and even existing machine learning baselines for posterior sampling, achieving better results within the same computational budget. The work also explores conditioning on sequence embeddings, aiming for a future phylogenetics foundation model capable of zero-shot inference.

Artificial Intelligence

View All
AI-Native Organisations Run on Skills: How to Structure and Scale Them — Imad Touil, QuantumBlack

AI-Native Organisations Run on Skills: How to Structure and Scale Them — Imad Touil, QuantumBlack

Imad Touil explores the critical need for governing AI skills within organizations, asserting that skills represent the true repository of enterprise know-how. He contrasts simplified coding agent loops with complex, real-world product lifecycles, demonstrating how ungoverned skills lead to technical debt—including duplication, quality degradation, security risks, and lack of discoverability. Proposing a microservices-inspired approach, Touil outlines a centralized skills platform and human-led governance model essential for achieving deterministic workflows, boosting productivity, and mitigating risks in AI-native enterprises.

Your Code Has Bugs. Lean4 Has Proofs: Formal Verification for Engineers — Varun Pant, AWS

Your Code Has Bugs. Lean4 Has Proofs: Formal Verification for Engineers — Varun Pant, AWS

Varun Pant introduces formal verification as the solution to reliably validate AI-generated code, proposing a division where humans define specifications and machines handle code and proof. He details Lean's role as a unified language for code and proof, exemplified by an AI rewriting zlib with 32,000 lines of proof, and AWS's Cedar using Lean specs with Rust production code reconciled by 100 million nightly tests. The talk also covers deductive verification with solvers and future cross-language verification with Strata, aiming for "provably correct" software.

How to Get Your Org to Adopt Coding Agents (Without Shipping Garbage) — Eyal Blum, Figma

How to Get Your Org to Adopt Coding Agents (Without Shipping Garbage) — Eyal Blum, Figma

Figma's internal AI agent adoption journey faces challenges like reduced developer agency, skepticism from senior engineers, and communication inefficiency. Solutions include investing in verification, using a testing pyramid for agent review, prioritizing detailed planning over prompting, engaging skeptics to build AI safety roadmaps, and implementing attention-aware communication by clearly marking AI-generated content.

Technology

View All
Platform Engineering for Developers, Architects & the Rest of Us • Daniel Bryant • GOTO 2025

Platform Engineering for Developers, Architects & the Rest of Us • Daniel Bryant • GOTO 2025

Daniel Bryant discusses platform engineering for software developers and architects, emphasizing treating platforms as internal products with developers as customers. He outlines a three-layered architecture, the evolution from monolithic systems to microservices, and the importance of 'golden bricks' over 'golden paths' for composability. Key takeaways include API-first design, minimizing cognitive load, avoiding leaky abstractions, and measuring success through frameworks like DORA and DevEx to achieve speed, safety, and scale.

Modern Enterprise Architecture: Architecting for Outcomes • Simon Rohrer • GOTO 2025

Modern Enterprise Architecture: Architecting for Outcomes • Simon Rohrer • GOTO 2025

Simon Rohrer challenges traditional Enterprise Architecture (EA) principles, proposing a modern approach focused on outcomes, continuous evolution, and socio-technical alignment. He outlines five key tenets: Aligning Value, People & Technology; achieving Better Value Sooner, Safer, Happier; implementing Continuous Conversational & Automated Governance; scaling DevOps across the enterprise; and fostering Evolutionary Enterprise Architecture.

Elon's Former Battery Chief on Making Transformers 100x Smaller | Drew Baglino, Heron Power

Elon's Former Battery Chief on Making Transformers 100x Smaller | Drew Baglino, Heron Power

Drew Baglino, former Tesla Powertrain & Energy head and now CEO of Heron Power, reveals why the current electricity grid is inadequate for the explosive growth of AI data centers. He explains how Heron Power's wideband gap power semiconductors will revolutionize grid-to-chip infrastructure, cutting power losses by half, shrinking massive transformers by 100x, and transforming data centers into grid-positive assets for a more efficient and sustainable energy future.

Recent Post

Why Top Founders Are Racing Into AI Infrastructure

Why Top Founders Are Racing Into AI Infrastructure

a16z's new Machine Age Fund addresses the unprecedented demand for AI infrastructure, shifting the bottleneck from models to the foundational hardware. The discussion highlights surging Hyperscaler CapEx, component supply crunch extending to 2028, and the exponential compute needs driven by reasoning and agents. It explores how AI turns engineering problems into capital/compute challenges, identifying opportunities for new infrastructure companies in chips, power, and data center redesign, and the emergence of experienced "systems founders" to rebuild the computing stack for this new era.

CLAUDE.md, AGENTS.md, Skills, Hooks and Subagents: A Field Guide to Steering AI Agents (Ep. 1022)

CLAUDE.md, AGENTS.md, Skills, Hooks and Subagents: A Field Guide to Steering AI Agents (Ep. 1022)

Episode 1022 dissects the crucial aspect of effectively steering AI agents by determining the optimal placement of instructions to ensure reliability and cost-efficiency. It explores seven distinct methods for instruction delivery, contrasting instructions as probabilities with hooks as guarantees, and highlights the industry-wide adoption of standards like `agents.md` and the importance of human-crafted guidance for superior agent performance.

Analyzing Group Chat Encryption in Messaging Applications

Analyzing Group Chat Encryption in Messaging Applications

This talk details a formal security analysis of group chat encryption algorithms in popular messaging applications like MLS, Session, and Keybase. It introduces Symmetric Sign Encryption (SSE) to model these protocols, identifying critical vulnerabilities such as insider replay and reordering attacks in MLS and Session due to insufficient context binding. The analysis highlights the complexities of key-dependent messages and key reuse, demonstrating how formal methods can pinpoint subtle design flaws and suggest robust mitigations for real-world secure communication.

Invited Research Talk: Measuring Generalization in EEG Foundation Models

Invited Research Talk: Measuring Generalization in EEG Foundation Models

This talk presents a multi-dimensional evaluation and interpretability framework for EEG foundation models. It reveals that current models often fail to outperform supervised baselines for BCI tasks, lack robustness to sparse channels, and exhibit an aperiodic low-frequency bias, making them better at capturing subject-specific rather than task-specific information. The analysis highlights critical deficiencies and suggests future directions for pre-training objectives and data collection to improve generalization.

TruthTable: A Verifiable Query Engine

TruthTable: A Verifiable Query Engine

TruthTable is a verifiable database engine that produces succinct cryptographic proofs for SQL query execution. It supports a wide range of SQL queries by leveraging query plans, polynomial encoding, and operator-specific PIOPs. It features a query planner with proof-specific optimizations and a novel batch compilation engine (ARCPOP). Benchmarks on TPC-H show average proving times of 55 seconds, verification times of 32 milliseconds, and proof sizes of 24kB, significantly outperforming prior academic and industrial systems in speed and expressiveness.

AI, Radio Astronomy, and the Search for Life Beyond Earth

AI, Radio Astronomy, and the Search for Life Beyond Earth

Ramiro Caisse Saide presents a multimodal deep-learning approach for technosignature detection in radio astronomy, using observations from Breakthrough Listen at MeerKAT. He investigates combining spectrograms with I/Q signal representations to improve signal detection and classification, particularly in low signal-to-noise environments. The talk also covers his extensive background in AI education, software development, the motivations behind SETI, fundamental radio astronomy concepts, and studies on Earth's own radio leakage.

← PreviousNext →

Stay In The Loop! Subscribe to Our Newsletter.

Get updates straight to your inbox. No spam, just useful content.