Tokenless

Interactive discovery

Explore the topic map

Follow the connections between themes, people, and ideas across the Tokenless archive in an interactive topic modeling map.

Machine Learning

View All
Invited Research Talk: Measuring Generalization in EEG Foundation Models

Invited Research Talk: Measuring Generalization in EEG Foundation Models

This talk presents a multi-dimensional evaluation and interpretability framework for EEG foundation models. It reveals that current models often fail to outperform supervised baselines for BCI tasks, lack robustness to sparse channels, and exhibit an aperiodic low-frequency bias, making them better at capturing subject-specific rather than task-specific information. The analysis highlights critical deficiencies and suggests future directions for pre-training objectives and data collection to improve generalization.

Can LLMs Write Fast Multi-GPU Kernels? — Simran Arora, Together AI

Can LLMs Write Fast Multi-GPU Kernels? — Simran Arora, Together AI

Simran Arora discusses the critical bottleneck shift in large AI workloads from GPU compute to inter-GPU communication. Her team's solution, ParallelKittens, offers a set of primitives to optimize multi-GPU kernels by leveraging fundamental transfer mechanisms and compute-communication overlapping. They introduce ParallelKernelBench, a benchmark to evaluate AI models' ability to generate such kernels, revealing that while models can handle syntax, they struggle with deeper reasoning about communication patterns and hardware trade-offs.

PhylaFlow: Hybrid flow matching in phylogenetic tree space

PhylaFlow: Hybrid flow matching in phylogenetic tree space

PhylaFlow is a hybrid flow-matching framework that navigates Billera–Holmes–Vogtmann (BHV) tree space to accelerate Bayesian phylogenetic inference. By learning geodesic paths from random trees to posterior samples, PhylaFlow efficiently initializes MCMC chains, drastically reducing the "burn-in" time. A PhylaFlow-MCMC variant, which guides MrBayes move acceptance, significantly outperforms traditional methods and even existing machine learning baselines for posterior sampling, achieving better results within the same computational budget. The work also explores conditioning on sequence embeddings, aiming for a future phylogenetics foundation model capable of zero-shot inference.

Artificial Intelligence

View All
AI-Native Organisations Run on Skills: How to Structure and Scale Them — Imad Touil, QuantumBlack

AI-Native Organisations Run on Skills: How to Structure and Scale Them — Imad Touil, QuantumBlack

Imad Touil explores the critical need for governing AI skills within organizations, asserting that skills represent the true repository of enterprise know-how. He contrasts simplified coding agent loops with complex, real-world product lifecycles, demonstrating how ungoverned skills lead to technical debt—including duplication, quality degradation, security risks, and lack of discoverability. Proposing a microservices-inspired approach, Touil outlines a centralized skills platform and human-led governance model essential for achieving deterministic workflows, boosting productivity, and mitigating risks in AI-native enterprises.

Your Code Has Bugs. Lean4 Has Proofs: Formal Verification for Engineers — Varun Pant, AWS

Your Code Has Bugs. Lean4 Has Proofs: Formal Verification for Engineers — Varun Pant, AWS

Varun Pant introduces formal verification as the solution to reliably validate AI-generated code, proposing a division where humans define specifications and machines handle code and proof. He details Lean's role as a unified language for code and proof, exemplified by an AI rewriting zlib with 32,000 lines of proof, and AWS's Cedar using Lean specs with Rust production code reconciled by 100 million nightly tests. The talk also covers deductive verification with solvers and future cross-language verification with Strata, aiming for "provably correct" software.

How to Get Your Org to Adopt Coding Agents (Without Shipping Garbage) — Eyal Blum, Figma

How to Get Your Org to Adopt Coding Agents (Without Shipping Garbage) — Eyal Blum, Figma

Figma's internal AI agent adoption journey faces challenges like reduced developer agency, skepticism from senior engineers, and communication inefficiency. Solutions include investing in verification, using a testing pyramid for agent review, prioritizing detailed planning over prompting, engaging skeptics to build AI safety roadmaps, and implementing attention-aware communication by clearly marking AI-generated content.

Technology

View All
Platform Engineering for Developers, Architects & the Rest of Us • Daniel Bryant • GOTO 2025

Platform Engineering for Developers, Architects & the Rest of Us • Daniel Bryant • GOTO 2025

Daniel Bryant discusses platform engineering for software developers and architects, emphasizing treating platforms as internal products with developers as customers. He outlines a three-layered architecture, the evolution from monolithic systems to microservices, and the importance of 'golden bricks' over 'golden paths' for composability. Key takeaways include API-first design, minimizing cognitive load, avoiding leaky abstractions, and measuring success through frameworks like DORA and DevEx to achieve speed, safety, and scale.

Modern Enterprise Architecture: Architecting for Outcomes • Simon Rohrer • GOTO 2025

Modern Enterprise Architecture: Architecting for Outcomes • Simon Rohrer • GOTO 2025

Simon Rohrer challenges traditional Enterprise Architecture (EA) principles, proposing a modern approach focused on outcomes, continuous evolution, and socio-technical alignment. He outlines five key tenets: Aligning Value, People & Technology; achieving Better Value Sooner, Safer, Happier; implementing Continuous Conversational & Automated Governance; scaling DevOps across the enterprise; and fostering Evolutionary Enterprise Architecture.

Elon's Former Battery Chief on Making Transformers 100x Smaller | Drew Baglino, Heron Power

Elon's Former Battery Chief on Making Transformers 100x Smaller | Drew Baglino, Heron Power

Drew Baglino, former Tesla Powertrain & Energy head and now CEO of Heron Power, reveals why the current electricity grid is inadequate for the explosive growth of AI data centers. He explains how Heron Power's wideband gap power semiconductors will revolutionize grid-to-chip infrastructure, cutting power losses by half, shrinking massive transformers by 100x, and transforming data centers into grid-positive assets for a more efficient and sustainable energy future.


Recent Post

AI Agents Gone Rogue? Build, Defend & Attack AI-Enabled Apps • Katie Paxton-Fear • YOW! 2025

AI Agents Gone Rogue? Build, Defend & Attack AI-Enabled Apps • Katie Paxton-Fear • YOW! 2025

Katie Paxton-Fear explores the emerging security landscape of AI agents, moving beyond chatbots to autonomous, specialized entities. She details five critical vulnerabilities: social engineering, hacking frameworks, malicious agents, AI as accidental insiders (vibe coding), and the rise of hackbots. The talk concludes with a powerful call to action for security professionals to proactively engage and influence AI agent development, emphasizing that 'abstinence-only education doesn't work' when it comes to AI adoption.

Rich Sutton and Khurram Javed: Why AI Models Stop Learning, and How to Start It Again

Rich Sutton and Khurram Javed: Why AI Models Stop Learning, and How to Start It Again

Rich Sutton and Khurram Javed discuss their radical vision for AI at Oak Lab, advocating for truly continual learning agents that learn from their own experience, rejecting synthetic data due to the "Big World Hypothesis," and outlining a path to overcome catastrophic forgetting with "continual backprop" for a trillion-parameter, self-maintaining mind, while critiquing LLMs as only a fraction of intelligence.

The Reason Your Claude Output Still Looks Like Slop (with Priyanka Vergadia)

The Reason Your Claude Output Still Looks Like Slop (with Priyanka Vergadia)

Priyanka Vergadia, The Cloud Girl, discusses why most companies see no ROI from AI tools, proposing a 7:1 budget split for training over tools. She explains how AI has made "taste" the new ceiling, detailing how to build effective Claude skills by breaking tasks into explicit subtasks with human-in-the-loop oversight. She introduces her 10-20-70 framework for AI budgets, emphasizing the long-term investment needed for employee skilling and community building. Priyanka also shares her transition to full-time entrepreneurship, focusing on product and career storytelling, and reveals her upcoming book on tech storytelling.

MCP Goes Stateless | ​John Dellenbaugh & Pankaj Kumar | MCP Release Party - Seattle

MCP Goes Stateless | ​John Dellenbaugh & Pankaj Kumar | MCP Release Party - Seattle

This session details the transformation of the MCP protocol to a stateless design, addressing previous scaling challenges by externalizing session state to a database and eliminating the need for sticky sessions and complex infrastructure. The presentation includes a live demo comparing stateful and stateless architectures, highlighting benefits in scalability and simplified deployment. It also covers considerations for security and data resiliency within this new paradigm.

Policy Enforcement and Tamper-Evident Audit Chains | ​Imran Siddique | MCP Release Party - Seattle

Policy Enforcement and Tamper-Evident Audit Chains | ​Imran Siddique | MCP Release Party - Seattle

Imran Siddique introduces cMCP, an open-source gateway that enhances Modular Control Plane (MCP) servers with policy enforcement and tamper-evident audit trails. It achieves this by running Cedar policy evaluation within Trusted Execution Environments (TEEs), ensuring that agent actions are governed securely and verifiably. The talk delves into the concept of "beyond governance" towards verifiable AI, the 'trace' standard for auditable logging, and the importance of confidential computing for regulated industries.

How to Kill the Code Review — Ankit Jain, Aviator

How to Kill the Code Review — Ankit Jain, Aviator

Ankit Jain argues that traditional line-by-line code review is defunct, with AI reviewing code that humans no longer read. He asserts that code review's vital, often overlooked, purpose is 'alignment'—knowledge sharing, mentorship, and architectural feedback—which current AI-driven workflows fail to capture. His proposal involves capturing user-AI interaction prompts as acceptance criteria, generating test plans with an 'AI Slop Registry' (codified recurring review comments), and verifying changes against live previews. The new review surface becomes the 'intent and evidence' rather than the code diff, preserving collaboration and ensuring semantic accuracy.

Stay In The Loop! Subscribe to Our Newsletter.

Get updates straight to your inbox. No spam, just useful content.