MiniCPM-V 4.7 runs 35B MoE on phones at 20.51 tokens/s
Smarter scheduling, not a smaller model, is what makes a 35B-parameter MoE fit and run fast on consumer phones — no retraining required, since routing stays untouched. Developers building on-device multimodal apps can grab the code and weights from GitHub and Hugging Face to run large models where cloud calls are impractical. It also shows open-source Chinese labs pulling ahead on mobile inference efficiency, a space Apple and Qualcomm stack owners care about.
