Pete Johnson, Field CTO of AI at MongoDB, discusses effective AI strategies, why most organizations struggle with AI ROI, and how to build reliable AI systems. He covers the importance of choosing the right embedding models for RAG pipelines, introduces Matryoshka embeddings, and explains the evolution of agentic memory to combat token maxing and ensure consistency in production AI.
Vinoo Ganesh, CEO of Kepler, discusses building verifiable AI for financial services. He argues that while LLMs are powerful probability machines, they are unreliable for deterministic financial tasks. Kepler's solution involves a deterministic substrate that wraps AI, based on three tenets: atomic provenance (AI references, not creates, numbers), scope determinism (AI decides what to compute, but deterministic tools perform the math), and derivation chains (traceable calculation paths for derived figures). This ensures numerical accuracy, verifiability, and traceability, moving beyond simple citations to true proof of work.
GPT-5 introduces five key improvements to address core limitations of large language models, including a new routing system for model selection, targeted training to reduce hallucinations, post-training penalties for sycophancy, a nuanced "safe completions" approach for sensitive topics, and chain-of-thought monitoring to prevent deception.