Drawing from their work fine-tuning an ASR model in Wolof and building a stereotype detection dataset, researchers from YUX share a practical toolbox for evaluating the cultural relevance of AI models and products. The session covers methods for data collection, model benchmarking, user testing, and introduces LOOKA, a platform for scalable human evaluation in the African context.
Qinge Xie from Georgia Tech presents a large-scale evaluation of modern website privacy policies using a novel LLM-based framework. The research systematizes privacy practices from 10 major US and EU regulations into 34 clauses and analyzes over 100,000 websites to reveal current trends in data collection, sharing, and consumer rights disclosure.
Jordan Fisher, co-founder of Standard AI and now at Anthropic, poses critical questions for startup founders facing the imminent arrival of AGI. He explores challenges from software commoditization and building trust in automated teams to finding durable moats and the ethical responsibility of building world-changing technology.
Engineer and author Piotr Sarna discusses his evolution from a reluctant writer to a book author, detailing a pattern-based approach to creating high-quality technical content and overcoming the common fears engineers face when writing.
Exploring the evolution of AI, this summary breaks down the Data-Information-Knowledge-Wisdom hierarchy, revisits past predictions about AI's limits that have since been surpassed—such as reasoning and creativity—and delves into current challenges like hallucinations, AGI, and sustainability. It concludes by framing a collaborative future where humans define the 'what' and 'why,' while AI executes the 'how'.
Microsoft’s Eric Horvitz and guests discuss the Paraphrase Project, a two-year red-teaming effort that uncovered and patched a significant biosecurity vulnerability, demonstrating a model for responsibly managing the dual-use risks of generative AI in protein design.