Ai governance

1,368 AI Failures and What They Teach About Evals — Vishal Srivastava & Tanmay Sah, New York Life

1,368 AI Failures and What They Teach About Evals — Vishal Srivastava & Tanmay Sah, New York Life

Vishal Srivastava and Tanmay Sah of New York Life analyze 1,368 public AI incidents to show what real failures reveal about how AI systems should be tested. They organize failures into three dimensions (technical strength, deployment controls, business impact) and 13 sub-dimensions covering about 98% of cases, find that weak deployment controls are most closely tied to harm, and present a materiality-based ranking of use cases, a failure-driven build-break-fix evaluation loop, and an airline chatbot refund case as an example.

Empowering Intelligence: democratizing data access and driving smarter decisions at Nasdaq

Empowering Intelligence: democratizing data access and driving smarter decisions at Nasdaq

A NASDAQ executive explains how high-performance compute and agentic AI are reshaping both the physical trading infrastructure (data centers, colocation, liquid cooling, and CoreWeave partnership) and the fintech software stack (Verafin, Axiom, Calypso) through a shared intelligence layer. The talk centers on trust, resilience, governance and the bounded-exception problem that makes agentic workflows hard to scale in a regulated market.

AI Agents Don't Read Your Policy Docs. They Hit Your APIs — Gravitee

AI Agents Don't Read Your Policy Docs. They Hit Your APIs — Gravitee

Sam, CTO at Gravity, argues that AI agent governance must be enforced in infrastructure rather than in prompts or policy documents. Through five live demos against a hotel-booking agent, he shows a gateway blocking destructive tool calls, preventing data exfiltration, rate-limiting runaway agents, serving cached semantic responses, and rejecting oversized prompts before any LLM call. He also covers observability, vendor decoupling via LLM routing, trimming bloated MCP tool lists, and managing shadow AI.

Building AI Agents for Everyone

Building AI Agents for Everyone

Gumloop co-founders Max Brodeur-Urbas and Rahul Behal discuss how a visual workflow builder evolved into an enterprise agent platform, what they learned from more than 1,100 customer calls, how a power user at Instacart opened the door to enterprise sales, and why the people who understand a task should be the ones automating it. The conversation covers enterprise requirements, pricing transparency, model neutrality, and the IT-led buying dynamics that shape adoption.

OpenAI cancels Astra release, Sonnet 5.5 & what Meta Muse means for work

OpenAI cancels Astra release, Sonnet 5.5 & what Meta Muse means for work

IBM's Mixture of Experts panel examines OpenAI's decision to withhold GPT-6.1 Astra, Anthropic's Sonnet 5.5 blurring the line between mid-tier and top-tier models, and Meta's Muse agent as a bridge between consumer AI habits and enterprise expectations, with a detour into token budgets, model routing, and AI governance.

The Caveman Prompting Challenge

The Caveman Prompting Challenge

James Barney, Head of Forward Labs at MetLife, discusses the operational challenges and strategic considerations for AI enablement in a large enterprise. Key topics include FinOps approaches to model selection based on cost, speed, and accuracy, optimizing LLM token usage through 'caveman prompting' and the proposed 'CaveBench' benchmark, and navigating volatile model release pricing. The conversation delves into measuring AI's value beyond cost, differentiating R&D from production token spend, and establishing robust AI governance using policy as code. A significant shift from traditional UIs to chat-based interfaces is explored, alongside the critical 'latent shopper problem' – the challenge of serendipitous data discovery in an AI-driven, query-focused world.