Automating document work with Long-Horizon AI Agents at LlamaIndex
Jerry, CEO of LlamaIndex, argues that as AI agents move from answering questions to running long-lived workflows, documents become their most important context source. He walks through the evolution from simple RAG to agent harnesses, explains why PDFs are hard to parse, and presents the company's approach to OCR, extraction with grounding, and document search. He closes by outlining unsolved problems: agent-native document formats, in-place editing, versioning, distilling frontier workflows into cheaper models, and long-horizon background agents.