Tokenless

Interactive discovery

Explore the topic map

Follow the connections between themes, people, and ideas across the Tokenless archive in an interactive topic modeling map.

Machine Learning

View All
Guardians of the State: An Air-Gapped AI Fortress for Consumer Data — Rachna Srivastava, DFPI

Guardians of the State: An Air-Gapped AI Fortress for Consumer Data — Rachna Srivastava, DFPI

Rachna Srivastava discusses building a legally defensible AI system for financial fraud detection, emphasizing that generative AI has eroded traditional trust. Her team at DFPI engineered an offline, hardware-secured data pipeline using Kafka, Spark, and semantic routing to ensure explainability, reproducibility, and auditability. They implemented a one-way data diode for secure learning and Apache Iceberg for time-travel queries, asserting that "trust is a physical property" built into the system's core.

Invited Research Talk: Measuring Generalization in EEG Foundation Models

Invited Research Talk: Measuring Generalization in EEG Foundation Models

This talk presents a multi-dimensional evaluation and interpretability framework for EEG foundation models. It reveals that current models often fail to outperform supervised baselines for BCI tasks, lack robustness to sparse channels, and exhibit an aperiodic low-frequency bias, making them better at capturing subject-specific rather than task-specific information. The analysis highlights critical deficiencies and suggests future directions for pre-training objectives and data collection to improve generalization.

Can LLMs Write Fast Multi-GPU Kernels? — Simran Arora, Together AI

Can LLMs Write Fast Multi-GPU Kernels? — Simran Arora, Together AI

Simran Arora discusses the critical bottleneck shift in large AI workloads from GPU compute to inter-GPU communication. Her team's solution, ParallelKittens, offers a set of primitives to optimize multi-GPU kernels by leveraging fundamental transfer mechanisms and compute-communication overlapping. They introduce ParallelKernelBench, a benchmark to evaluate AI models' ability to generate such kernels, revealing that while models can handle syntax, they struggle with deeper reasoning about communication patterns and hardware trade-offs.

Artificial Intelligence

View All
AI-Native Organisations Run on Skills: How to Structure and Scale Them — Imad Touil, QuantumBlack

AI-Native Organisations Run on Skills: How to Structure and Scale Them — Imad Touil, QuantumBlack

Imad Touil explores the critical need for governing AI skills within organizations, asserting that skills represent the true repository of enterprise know-how. He contrasts simplified coding agent loops with complex, real-world product lifecycles, demonstrating how ungoverned skills lead to technical debt—including duplication, quality degradation, security risks, and lack of discoverability. Proposing a microservices-inspired approach, Touil outlines a centralized skills platform and human-led governance model essential for achieving deterministic workflows, boosting productivity, and mitigating risks in AI-native enterprises.

Your Code Has Bugs. Lean4 Has Proofs: Formal Verification for Engineers — Varun Pant, AWS

Your Code Has Bugs. Lean4 Has Proofs: Formal Verification for Engineers — Varun Pant, AWS

Varun Pant introduces formal verification as the solution to reliably validate AI-generated code, proposing a division where humans define specifications and machines handle code and proof. He details Lean's role as a unified language for code and proof, exemplified by an AI rewriting zlib with 32,000 lines of proof, and AWS's Cedar using Lean specs with Rust production code reconciled by 100 million nightly tests. The talk also covers deductive verification with solvers and future cross-language verification with Strata, aiming for "provably correct" software.

How to Get Your Org to Adopt Coding Agents (Without Shipping Garbage) — Eyal Blum, Figma

How to Get Your Org to Adopt Coding Agents (Without Shipping Garbage) — Eyal Blum, Figma

Figma's internal AI agent adoption journey faces challenges like reduced developer agency, skepticism from senior engineers, and communication inefficiency. Solutions include investing in verification, using a testing pyramid for agent review, prioritizing detailed planning over prompting, engaging skeptics to build AI safety roadmaps, and implementing attention-aware communication by clearly marking AI-generated content.

Technology

View All
Platform Engineering for Developers, Architects & the Rest of Us • Daniel Bryant • GOTO 2025

Platform Engineering for Developers, Architects & the Rest of Us • Daniel Bryant • GOTO 2025

Daniel Bryant discusses platform engineering for software developers and architects, emphasizing treating platforms as internal products with developers as customers. He outlines a three-layered architecture, the evolution from monolithic systems to microservices, and the importance of 'golden bricks' over 'golden paths' for composability. Key takeaways include API-first design, minimizing cognitive load, avoiding leaky abstractions, and measuring success through frameworks like DORA and DevEx to achieve speed, safety, and scale.

Modern Enterprise Architecture: Architecting for Outcomes • Simon Rohrer • GOTO 2025

Modern Enterprise Architecture: Architecting for Outcomes • Simon Rohrer • GOTO 2025

Simon Rohrer challenges traditional Enterprise Architecture (EA) principles, proposing a modern approach focused on outcomes, continuous evolution, and socio-technical alignment. He outlines five key tenets: Aligning Value, People & Technology; achieving Better Value Sooner, Safer, Happier; implementing Continuous Conversational & Automated Governance; scaling DevOps across the enterprise; and fostering Evolutionary Enterprise Architecture.

Elon's Former Battery Chief on Making Transformers 100x Smaller | Drew Baglino, Heron Power

Elon's Former Battery Chief on Making Transformers 100x Smaller | Drew Baglino, Heron Power

Drew Baglino, former Tesla Powertrain & Energy head and now CEO of Heron Power, reveals why the current electricity grid is inadequate for the explosive growth of AI data centers. He explains how Heron Power's wideband gap power semiconductors will revolutionize grid-to-chip infrastructure, cutting power losses by half, shrinking massive transformers by 100x, and transforming data centers into grid-positive assets for a more efficient and sustainable energy future.


Recent Post

From Writing Code to Designing Systems: How the Developer Role is Changing — Chris Noring, Microsoft

From Writing Code to Designing Systems: How the Developer Role is Changing — Chris Noring, Microsoft

This talk introduces a paradigm shift in software development, moving developers from pure code producers to system designers and agent orchestrators. It details a new workflow leveraging GitHub Copilot CLI, custom Copilot agents, and explicit guardrails like `agents.md` and skills. The focus is on how to decompose complex problems, delegate implementation to AI, and encode architectural standards and constraints directly, enabling higher consistency, quality, and accelerated delivery through a "human-in-the-loop" delegation model.

Podcast Crossover: AIE, AGI, frontier lab strategy with ​ ⁨@matthew_berman⁩  and @swyxtv

Podcast Crossover: AIE, AGI, frontier lab strategy with ​ ⁨@matthew_berman⁩ and @swyxtv

Matt, the organizer of the AI.engineer conference, shares insights into its origin, the challenges of early adoption, and its current value as a neutral ground for AI labs. He delves into AI hardware trends, discussing specialized chips like Etched, and gives a nuanced take on Anthropic's Fable, addressing performance concerns and compute limitations. The conversation then explores OpenAI's rumored equity offer to the US government, discussing implications for regulation and societal involvement. Matt shares his perspective on AI existential risk and alignment, emphasizing the need for pragmatic engineering solutions. Finally, he outlines the limitations of current LLMs, the critical need for data efficiency, and offers strategic advice for "Agent Labs" navigating the "model capability overhang" versus multi-model agnosticism.

Should AI Engineers Still Read Code in 2026? The Z/L Continuum — Alex Volkov, ThursdAI

Should AI Engineers Still Read Code in 2026? The Z/L Continuum — Alex Volkov, ThursdAI

Alex Volkov introduces the "Z/L Continuum," a framework for navigating the tension between rapid AI-generated code production and the critical need for human review. He argues that the key lies in understanding that the continuum applies to tasks, not individuals, and presents a pragmatic routing table for verifying changes based on their criticality, highlighting the shift towards engineering systems that build and verify code, rather than meticulously inspecting every line. The talk also touches on emerging capabilities like Fable and "loops" and the importance of flexibility and human judgment in the evolving AI engineering landscape.

General relativity from first principles – Adam Brown

General relativity from first principles – Adam Brown

Adam Brown elucidates Einstein's General Relativity, tracing its origins from the equivalence principle and curved spacetime to the mind-bending physics of black holes. He covers the striking observational evidence for black holes and the historical confirmation of GR, concluding with a speculative discussion on how AI could accelerate scientific discovery as 'superhuman explainers'.

Understanding the inner thoughts of AI

Understanding the inner thoughts of AI

Neel Nanda, head of Google DeepMind's language model interpretability team, discusses the critical field of interpretability, likening it to the "neuroscience of AI." He explains why understanding the internal workings of "grown, not designed" neural networks is crucial for AI safety and scientific discovery. The episode explores cutting-edge techniques like Chain of Thought monitoring, mechanistic interpretability (steering and probing), and Sparse Autoencoders, highlighting their strengths and limitations in debugging, detecting deception, and uncovering hidden model objectives. Nanda emphasizes interpretability's role in building safe, aligned, and trustworthy AI as we approach AGI, acknowledging its pragmatic necessity despite inherent limits to full understanding.

Reddit cracks down on AI slop & the future of AI compute

Reddit cracks down on AI slop & the future of AI compute

This episode explores Reddit's aggressive AI spam combat strategy, revealing AI's dual role in fighting malicious AI. It then dissects Anthropic's Economic Index, highlighting how Claude integrates into daily life despite significant user selection bias. The discussion also covers Orin's $33M raise for a GPU compute marketplace, debating the fungibility of compute and the technical hurdles. Finally, Anthropic's chip ambitions are analyzed as an economic strategy to optimize models, reduce NVIDIA dependency, and manage rising token costs, with comparisons to existing hardware ecosystems and NVIDIA's market position.

Stay In The Loop! Subscribe to Our Newsletter.

Get updates straight to your inbox. No spam, just useful content.