Xiaomi MiMo-V3 to Adopt New Architecture with HySparse 2
The architecture targets agentic workloads, where each turn appends long observations and prefill cost, cache size and retrieval accuracy sit on the critical path simultaneously. Switching from block-level to token-level selection and folding SWA into a forced recent window gives local and global tokens one shared KV cache. Developers building long-context agents should watch MiMo-V3's release, especially against open-source alternatives like DeepSeek and Qwen in the same weight class.