#DeepSeek-R1-Distill-Qwen-7B

5 stories · 2 in 7 days · 3 in 30 days
Stories, products and papers tagged "DeepSeek-R1-Distill-Qwen-7B", newest first.
Oct 23
PapersBuildersSelected10:54
Study Finds Speculative Decoding Acceptance Does Not Decay Over Long Chain-of-Thought

The finding overturns the widely repeated narrative that acceptance rate falls as chains grow, which has driven draft-model co-design and position-aware training spending. Teams building inference acceleration should redirect effort from positional engineering toward entropy at decision points, where the paper localizes the real failure. The MATH-500 baseline and open diagnostic protocol are directly reusable for benchmarking any draft-target pairing.

arXiv: DeepSeek@Zhiming MengSource
Oct 22
Sep 30
ModelsBuildersSelected10:44
MetaCtrl: Metacognitive Controller for LRMs

MetaCtrl addresses a critical inefficiency in reasoning models by dynamically determining when additional computation is beneficial, eliminating the need for predefined budgets or retraining. This plug-and-play solution significantly improves accuracy while reducing inference costs, making it valuable for developers working with resource-constrained environments. The open-source implementation allows immediate integration into existing reasoning pipelines.

arXiv: DeepSeek@Zhibin Wen et al. (5)Source
Aug 17
Jul 24