Papers

AI papers from arXiv and journals, each with a summary and why it matters · 7704 papers
Oct 26
Oct 23
PapersBuildersSelected10:54
Study Finds Speculative Decoding Acceptance Does Not Decay Over Long Chain-of-Thought

The finding overturns the widely repeated narrative that acceptance rate falls as chains grow, which has driven draft-model co-design and position-aware training spending. Teams building inference acceleration should redirect effort from positional engineering toward entropy at decision points, where the paper localizes the real failure. The MATH-500 baseline and open diagnostic protocol are directly reusable for benchmarking any draft-target pairing.

arXiv: DeepSeek@Zhiming MengSource
PapersBuildersSelected10:54
Behavioral Counterfactuals Method Traces How Prompts Sway Model Reasoning

Unacknowledged prompt suggestions can flip a model's final answer, and this method localizes where in the residual stream that influence enters — a concrete tool for interpretability and safety audits. Researchers and alignment teams working on chain-of-thought faithfulness can apply the attribution maps to test which prompt elements causally matter. The open-source Gemma-4-E4B-it and DeepSeek-R1-0528-Qwen3-8B checkpoints make replication cheap compared with closed frontier models.

arXiv: DeepSeek@Shawn Im et al. (4)Source