AI Engineer · AI

Why AI Agents Need Million-Token Context — Thomas Wolf & Olive Song, MiniMax

An intern designed the sparse-attention architecture behind MiniMax M3. That detail comes after Olive Song explains the larger problem the team was trying to solve: short context windows aren’t enough when agents must work across long conversations, tool responses and complex environments. M3 combines a functional one-million-token context window with coding, agentic and multimodal capabilities, allowing it to understand text, images and video wi

Introductie van de bron.