MAPLE这个插件能让MoE大模型少开专家还更准，DeepSeek-MoE-16B用75%专家就能超原版，还快32%，不用改权重就能用。
MAPLE是一个即插即用的MoE专家分配框架，可在不修改权重不重训练的前提下，按层重新分配路由专家预算。其核心是封闭式灵敏度引导分配，并用灵敏度约束的遗传搜索进一步优化。在DeepSeek-MoE-16B上，MAPLE仅用75%专家即在ARC-E上从65.09提升至71.40，ARC-C从48.49提升至51.50，BoolQ从80.03提升至82.38。通过SGLang部署，单GPU端到端延迟降低32.2%，吞吐量提升47.4%。
MAPLE: MoE Adaptive Plug-and-play Layer-wise Expert allocation
Sparsely-activated Mixture-of-Experts (MoE) Transformers universally fix the same number of routed experts across all layers, a convention that ignores the well-documented heterogeneity in layer-wise redundancy. We demonstrate that this uniformity is systematically suboptimal and propose MAPLE, a plug-and-play framework that reallocates the routed-expert budget heterogeneously across layers of any pretrained MoE LLM, without modifying weights or requiring retraining. Our core contribution is a closed-form sensitivity-guided allocation: we probe each layer's response to variation in expert count, quantify sensitivity using three measures, and derive an analytically optimal budget assignment that directs capacity towards sensitive layers and absorbs reductions in redundant layers. This closed-form solution is further refined by a sensitivity-constrained genetic search that uses layer-wise sensitivity as a prior to guide exploration, yielding faster convergence and superior allocation quality. On four MoE models spanning different scales and architectures, MAPLE outperforms uniform and pruning-based baselines under a 75% routed-expert budget. Notably, on DeepSeek-MoE-16B, MAPLE uses only 75% of the experts yet surpasses the original 100% expert-uniform baseline on ARC-E, ARC-C, and BoolQ, improving accuracy from 65.09 to 71.40, 48.49 to 51.50, and 80.03 to 82.38, respectively. These accuracy gains translate into measured deployment efficiency: implementing MAPLE in SGLang reduces single-GPU end-to-end serving latency by 32.2% and improves throughput by 47.4%. These results show that well-designed heterogeneous allocation can be more effective than simply activating more experts, establishing it as a principled and practical axis for improving MoE efficiency.