Don't Approve the AI Model. Approve the App - Doneyli De Jesus, Langfuse

Doneyli De Jesus, AI engineering lead at Langfuse, describes how a top-five bank built deployment gates for AI agents in an on-premises, air-gapped environment. He covers golden data sets, multi-dimensional scoring, why a model that was 97% grounded still failed on numbers until it was given a calculator tool, and how domain experts set thresholds and review failures, cutting evaluation time from weeks to minutes.