#MiMo-V3

Two-level KV sharing targets the long-context prefill bottleneck that agentic workloads hit, cutting compute without a full attention redesign. Engineers building long-context inference stacks can benchmark the approach against hybrid SWA baselines on similar MoE setups. The MiMo-V3 linkage also signals how Xiaomi positions its model stack against domestic rivals like DeepSeek and Qwen.

官方一手pandaily@[email protected] (Pandaily)3 sourcesSource

The architecture targets agentic workloads, where each turn appends long observations and prefill cost, cache size and retrieval accuracy sit on the critical path simultaneously. Switching from block-level to token-level selection and folding SWA into a forced recent window gives local and global tokens one shared KV cache. Developers building long-context agents should watch MiMo-V3's release, especially against open-source alternatives like DeepSeek and Qwen in the same weight class.