The finding overturns the widely repeated narrative that acceptance rate falls as chains grow, which has driven draft-model co-design and position-aware training spending. Teams building inference acceleration should redirect effort from positional engineering toward entropy at decision points, where the paper localizes the real failure. The MATH-500 baseline and open diagnostic protocol are directly reusable for benchmarking any draft-target pairing.
#DeepSeek-R1-Distill-Qwen-7B
5 stories · 2 in 7 days · 3 in 30 days
Stories, products and papers tagged "DeepSeek-R1-Distill-Qwen-7B", newest first.
Oct 23
Study Finds Speculative Decoding Acceptance Does Not Decay Over Long Chain-of-Thought
Oct 22
Chinese contentQSelect 为太空机器人机载语言模型提供低比特压缩方案
arXiv 上这篇论文教你怎么把 7B/8B 模型压到 3-4 比特还给太空机器人用,混搭三种量化器比单用一种效果更好,做端侧部署的可以看看。
Sep 30
MetaCtrl: Metacognitive Controller for LRMs
MetaCtrl addresses a critical inefficiency in reasoning models by dynamically determining when additional computation is beneficial, eliminating the need for predefined budgets or retraining. This plug-and-play solution significantly improves accuracy while reducing inference costs, making it valuable for developers working with resource-constrained environments. The open-source implementation allows immediate integration into existing reasoning pipelines.
Aug 17
Papers10:18
Chinese content批量自适应剪枝:周期性神经元激活感知的推理模型压缩法DeepSeek-R1-Distill-Qwen-7B实测:批大小4准确率比旧剪枝高39.7个点,还有1.40倍加速。
Jul 24
Papers09:24
Chinese content令牌预算饱和与思维链推理非收敛的早期机制检测这篇论文发现DeepSeek-R1推理非收敛在早期就能从内部表征检测到,未来可做自适应计算分配,研究推理效率的朋友可以看看。