Jack McDonald of Apollo's Redding Ridge and Michael Manapat of Rowspace discuss where AI becomes mission-critical in structured credit and CLO management. They cover compressing portfolio construction from days to minutes, automating the weekly trade reconciliation, and why embedding engineers with front-office teams, rather than relying on generic LLMs, is what earns trust in financial data.
Abi Aryan discusses the shift from MLOps to LLMOps, framing generative AI deployment as a distributed systems challenge. She highlights the critical role of FinOps due to high model costs, the need for custom tooling over generic agent frameworks, and the importance of a 'decision layer' for agent autonomy. Observability is re-conceptualized as anomaly detection, and she points to dynamic RL environments and strong data engineering as future research priorities and essential skills for AI engineers.
Rachna Srivastava discusses building a legally defensible AI system for financial fraud detection, emphasizing that generative AI has eroded traditional trust. Her team at DFPI engineered an offline, hardware-secured data pipeline using Kafka, Spark, and semantic routing to ensure explainability, reproducibility, and auditability. They implemented a one-way data diode for secure learning and Apache Iceberg for time-travel queries, asserting that "trust is a physical property" built into the system's core.
This episode explores the foundations of AI agent memory, drawing parallels with human neuroscience. It also covers the practical impact of AI on data engineering roles, the democratization of AI development through low-code tools, and innovative applications of AI in elementary education to foster critical thinking.
Variance, emerging from three years in stealth with a $21 million Series A, is transforming enterprise risk and compliance through purpose-built AI agents. Founded by ex-Apple engineers, the company automates complex tasks like fraud detection, content review, and identity verification for Fortune 500s and platforms such as GoFundMe. They discuss the strategic reasons for stealth, technical challenges of integrating disparate data sources (including UI scraping), the shift from legacy systems to self-healing AI agent architectures, and how their lean, AI-maximalist team detects sophisticated threats like state-sponsored fraud rings.
Rohit Choudhary, CEO of Acceldata, discusses the imminent 10x annual growth of enterprise data and how most organizations are unprepared. He introduces Acceldata's agentic data management platform, designed to make data self-aware, self-optimizing, and AI-ready. He emphasizes the 1000x cost difference of fixing data early versus late, the need for operational, real-time data governance, and why clear thinking and deep domain expertise, not just programming skills, will be most valuable in the age of AI.