Papers14:09
Chinese content研究揭示优化器数值精度墙：Adam 在幂律谱低秩矩阵感知中的失效边界一篇优化器理论论文：解释了 Adam 在幂律测量谱下为什么会莫名卡住，给出了能预测失效起点的公式，做低秩优化的可以看看。
#数值精度
3 stories · 0 in 7 days · 1 in 30 days
Stories, products and papers tagged "数值精度", newest first.
Oct 30
Sep 23
Precision Choices Break Greedy Decoding Determinism in LLMs
Anyone chasing reproducible LLM outputs — evaluation harness authors, serving teams and quantisation engineers — should treat BF16 vs FP16 as a real source of run-to-run variance, not an implementation detail. The paper offers a low-overhead fix (threshold-triggered FP32 LM head recomputation) and maps when it fails, including FP8 end-to-end serving. The margin-based analysis also gives practitioners a quick diagnostic for whether their own deployments are at risk.
Jul 31