想了解怎么让扩散大模型跑得快?这篇综述把加速方法分了三个维度,还给了评测框架,搞推理优化的值得看。
本文对扩散大语言模型(dLLM)的推理加速技术进行了系统综述。研究指出,并行生成并不天然带来实际速度提升,需要专门推理机制如扩散感知缓存与复用。作者提出了一个统一的延迟分解框架,用于解耦算法、架构和系统层面的因素。文章从算法创新、架构与系统优化、推理时缩放三个维度对加速技术进行了分类。最后,给出了可重复基准测试的指南,并指出了实现并行生成潜力所面临的开放挑战。
Accelerating Masked Diffusion Large Language Models: A Survey of Efficient Inference Techniques
Diffusion large language models (dLLMs) offer a theoretical advantage in parallel generation over standard autoregressive models. However, parallel generation alone does not guarantee practical speedups. Realizing this efficiency requires specialized inference mechanisms, such as diffusion-aware caching and reuse. Consequently, as inference efficiency becomes a prerequisite for practical deployment, recent research has actively explored acceleration techniques across algorithms, architectures, and systems. However, rigorous comparisons remain difficult, as end-to-end latency stems from intricate trade-offs between algorithmic, architectural, and system-level factors that are often conflated in existing benchmarks. In this survey, we introduce a unified latency decomposition framework for dLLMs to disentangle these factors and analyze their impact on inference speed in real deployments. Guided by this framework, we categorize acceleration techniques along three axes covering algorithmic innovations, architectural and system optimizations, and inference-time scaling. Finally, we provide guidelines for reproducible benchmarking and highlight open challenges for realizing the full potential of parallel generation.