Xiaomi's MiMo-V2.6 RL training
MiMo-V2.6 demonstrates massive RL scaling with 2B tokens per step, offering insights for developers working on large-scale AI training.
Xiaomi live-streamed the reinforcement learning run behind MiMo-V2.6, processing ~2B tokens per step with 1568 prompts and 16 rollouts. The system uses fully async, multi-task agentic RL across mixed harnesses. The company spent nearly half a year studying how far RL can scale. Details will be open-sourced over the coming weeks.
Xiaomi live-streamed the RL run behind V2.6 while it trained: ~2B tokens per step, 1568 prompts x 16 rollouts, fully async, multi-task agentic RL across mixed harnesses. Details are being open-sourced over the coming weeks. @_LuoFuli on how they scaled it: x.com/_LuoFuli/statu… Fuli Luo @_LuoFuli Nearly half a year of silence. We spent it studying one problem: how far RL can scale. MiMo-V2.6 is in the middle of its RL run right now. Three things we scaled: compute (~2B tokens per step, 1568 prompts × 16 rollouts, fully async), environments and harnesses (multi-task agentic RL, mixed across multiple harnesses in one run), and grader compute (agentic in-group credit assignment, with test-case and rubric-based rewards). We'll open-source the details piece by piece over the coming weeks. Streaming the run: mimo.xiaomi.com/rl/ 🔗 View Quoted Tweet 💬 0 🔄 1 ❤️ 7 👀 1899 📊 1 ⚡