Jun 19, 2026

The data black hole at the center of AI

AI progress is fundamentally driven by vast amounts of data and compute, rather than improvements in sample efficiency, creating a stark contrast with human learning. This essay explores the "black hole of data" powering AIs, quantifies the massive sample-efficiency gap between humans and machines, counters common objections, and discusses the implications for white-collar automation and future AI research.

Mar 24, 2026

Attention, World Models and the Future of AI — with Prof. Kyunghyun Cho

Professor Kyunghyun Cho, a co-author of the first paper on attention, discusses the future of AI. He argues that today’s models have already captured most correlations in passive data, making the real challenge about actively choosing which data to collect. He also explores the open debate around world models, the surprising lack of coding agent adoption among his students, and the foundational work that led to Retrieval-Augmented Generation (RAG).