Evaluation frameworks

Jul 22, 2026

Your Moat Is Your Data Model — Mike Phipps, Gates Foundation

Mike Phipps from the Gates Foundation details how they built a Strategic Intelligence Platform (SIP) using a Neo4j knowledge graph to serve AI agents. He argues that the true "moat" in an AI-commoditized world lies in an organization's unique data model and tacit knowledge, not in generic AI tools. The platform unifies 25 years of siloed grantmaking data, integrating structured and unstructured information through a rigorous curation pipeline, and is refined via continuous retrieval evaluations to ensure alignment with organizational reporting standards.

Jul 15, 2026

Computer-Use 2.0: Agents Just Got Multi-Cursor — Francesco Bonacci, Cua

This talk introduces cua driver, an open-source tool enabling AI agents to interact with computer GUIs in the background across macOS, Windows, and Linux by leveraging accessibility APIs. It details CUABench, a robust evaluation framework with over 130 verifiable tasks designed to benchmark and ensure the trustworthiness of computer-using agents, revealing current limitations in complex tasks like circuit design. Finally, it presents cua fleet, an infrastructure solution that optimizes GPU utilization and reduces costs for RL training of these agents by dynamically managing sandbox environments.

Jul 13, 2026

The Prime Intellect Stack — Will Brown, Prime Intellect

Deep dive into Prime Intellect's open-source ecosystem for post-training LLMs, covering the modular Verifiers V1 environment design, the asynchronous and scalable Primer RL training framework, and the Lab platform for hosted training and fine-tuning. Learn about advanced reward systems, the interception server pattern, and tokenization control with the Renderers library, all designed to enable frontier agentic model development.