Oct 10, 2026

How MiniMax M3 Was Built: Sparse Attention and Native Multimodality — Olive Song

Olive from MiniMax walks through MiniMax M3, an open-weight model built for agentic coding, 1M token context, and native multimodality from the first training step. The talk centers on MSA, a GQA-aware block-level sparse attention design co-developed with GPU infrastructure in mind, and on why training text and vision together from scratch beats adding vision later.

Jul 31, 2026

Agents at Scale: Inside MiniMax's Model and the Infrastructure Behind It — Olive Song

Olive Song, RL lead at MiniMax, details the engineering behind MiniMax's open-weight models, focusing on M3's multimodal and agentic capabilities, the necessity of day-zero inference stack readiness, and continuous GPU kernel optimization. She discusses multimodal training challenges, long-horizon task evaluation, and expresses optimism for open models rapidly closing the gap with frontier labs.