Tokenless

Machine learning infrastructure

The End of TCP for AI Clusters — John Ousterhout, Stanford

The End of TCP for AI Clusters — John Ousterhout, Stanford

John Ousterhout argues that AI workloads are shifting from large data transfers to small, frequent coordination messages, making network latency (especially tail latency) a critical bottleneck. He explains why traditional protocols like TCP and RDMA are ill-suited due to sender-side congestion control and their byte-stream model. Ousterhout then introduces Homa, a new protocol designed from scratch with message-based communication, receiver-side congestion control, and switch priority queue utilization, demonstrating significant improvements in tail latency for AI applications.

The Prime Intellect Stack — Will Brown, Prime Intellect

The Prime Intellect Stack — Will Brown, Prime Intellect

Deep dive into Prime Intellect's open-source ecosystem for post-training LLMs, covering the modular Verifiers V1 environment design, the asynchronous and scalable Primer RL training framework, and the Lab platform for hosted training and fine-tuning. Learn about advanced reward systems, the interception server pattern, and tokenization control with the Renderers library, all designed to enable frontier agentic model development.

Turbocharge Your Agent's Retrieval with TurboQuant - Shashi Jagtap, Superagentic AI

Turbocharge Your Agent's Retrieval with TurboQuant - Shashi Jagtap, Superagentic AI

This talk introduces TurboQuant, a training-free compression method from Google Research that reduces embedding memory footprint by 5x (from 32-bit to 3-4 bits) without losing search quality. It details how TurboQuant works through scalar quantization and a crucial one-bit error correction step, QJL, enabling agents to remember more on existing hardware by optimizing both KV cache and RAG vector stores. A live demo showcases its effectiveness, making it a vendor-neutral solution for efficient AI agent retrieval.

⚡️Every product of the future will be a living system — Ronak Malde, Trajectory.ai

⚡️Every product of the future will be a living system — Ronak Malde, Trajectory.ai

Ronuk Malde, CEO of Trajectory.ai, discusses his journey from building AI coding agents at Windsurf to his current focus on continual learning for enterprise AI. He shares insights on leveraging real-world user data, the unique challenges of model acquisition, and how Trajectory.ai's platform, powered by innovations like scaled SDPO and a novel training stack, enables dynamic, always-learning AI models for diverse industries from legal to finance.