A bank's AI demo works but cannot ship due to non-engineering problems like security, data ownership, and risk approval. Paden Gayle outlines a method focusing on early stakeholder discovery, iterative workflow scoping, gradual autonomy, and a comprehensive evidence pack to build AI systems with a credible path to production, emphasizing that "discovery is the engineering."
This podcast explores the friction between frontier AI labs and cybersecurity experts, who disagree on AI safety priorities (alignment vs. traditional controls). It discusses the dual risks of open-weight AI models enabling sophisticated hacks like the TikTok camera exploit, and the challenges of CISA's call for transparent breach disclosures amidst corporate self-interest and the complexities of global AI regulation.
AIUC co-founder Rune Kvist discusses their $40M Series A, emphasizing that AI adoption's biggest constraint is trust, not capability. He details AIUC-1, their quarterly-updated standard for agent security and reliability, and their expansion into model certification to bridge the trust gap between frontier labs and governments. Kvist highlights the critical role of standards and insurance (partnering with Lloyds of London) in quantifying and mitigating AI risks, from agent liability to national security concerns, and preparing for future challenges in robotics and multi-agent systems.
Elad and Sarah discuss the rapid rise of AI's multi-trillion-dollar companies, debating whether this growth is sustainable or an anomaly. They explore how founder ambition is shaped by fear of AI labs, optimal strategies for startup exits, and the psychological impact of impending AGI on researchers. Key bottlenecks like compute power, the emergence of an oligopoly, and the growing threat of regulatory capture—exemplified by California's tax policies—are also analyzed, highlighting the critical societal trade-off between safety and technological progress.
Lloyd Blankfein, former CEO of Goldman Sachs, shares insights on leadership in crisis, the philosophy of risk management, and the evolution of institutional culture. He discusses navigating the 2008 financial crisis, the transition from a partnership to a public company, and the profound impact of technology and AI on finance and risk.
Variance, emerging from three years in stealth with a $21 million Series A, is transforming enterprise risk and compliance through purpose-built AI agents. Founded by ex-Apple engineers, the company automates complex tasks like fraud detection, content review, and identity verification for Fortune 500s and platforms such as GoFundMe. They discuss the strategic reasons for stealth, technical challenges of integrating disparate data sources (including UI scraping), the shift from legacy systems to self-healing AI agent architectures, and how their lean, AI-maximalist team detects sophisticated threats like state-sponsored fraud rings.