Vision transformer

Oct 10, 2026

How MiniMax M3 Was Built: Sparse Attention and Native Multimodality — Olive Song

Olive from MiniMax walks through MiniMax M3, an open-weight model built for agentic coding, 1M token context, and native multimodality from the first training step. The talk centers on MSA, a GQA-aware block-level sparse attention design co-developed with GPU infrastructure in mind, and on why training text and vision together from scratch beats adding vision later.

Jun 19, 2025

The nature of AI: solving the planet's data gap with Drew Purves

AI is being used to address critical information gaps in ecology. This summary covers how deep learning models like vision transformers and foundational models for sound are applied to map global forests, monitor deforestation, track species, and analyze bioacoustics to understand ecosystem health and animal communication.