Einstein Arena: Harnessing Collective Agent Intelligence for Open Science — James Zou, Together AI

James Zou presents a novel approach to AI development by advocating for the design of environments over workflows, fostering emergent intelligence and creativity. He introduces the **Einstein Arena**, where AI agents collaboratively and competitively solved open scientific problems like the kissing number problem, achieving breakthrough results (e.g., 604 spheres in 11 dimensions). The same principles successfully optimized GPU kernels, leading to 2x+ speedups. He also discusses **DSGym**, an environment for data science agents, addressing shortcomings of existing benchmarks by eliminating 'shortcuts' and enabling the training of high-performing, fine-tuned open-source models runnable on laptops.