How to Know When an AI Agent Can Work Unsupervised — Evan Kormos, Coinbase

Evan Kormos of Coinbase presents a practical framework for bringing AI agents into policy-driven, regulated workflows. He models processes as DAGs with loops inside each node, argues that a loop is only as trustworthy as its check, and shows how evals and traces create a new confidence mechanism. Agents then move through supervised, sampled, and exception-only stages.