Tokenless

Data pipelines

The Index is never done

The Index is never done

Exa's Jon details how their company maintains a massive, continuously updated semantic index of 100 billion pages to serve AI agents. The talk covers Exa's unique incremental indexing system, a custom data processing framework called "Skeleton" that handles 100,000 pages per second, and "Pythia," an elastic, cost-aware GPU orchestration system for managing both real-time ingestion and large-scale index re-embeddings.

957: How AI Agents Are Automating Enterprise Data Operations, with Ashwin Rajeeva

957: How AI Agents Are Automating Enterprise Data Operations, with Ashwin Rajeeva

Ashwin Rajeeva, cofounder and CTO of Acceldata, details the architecture and philosophy behind their Agentic Data Management (ADM) platform. He explains how the Xlake reasoning engine provides crucial context for AI agents to operate across petabyte-scale enterprise data, enabling capabilities like self-healing data pipelines and automated data quality assurance, while also discussing strategies for leading technical teams in the age of AI.