Papers12:07Chinese content研究对比乘法与加法状态耦合对学习式优化器调度的影响一篇优化器调度的架构对比实验:乘法耦合的调度能泛化到大 15 个种子验证的分布外实例,加法版不行,做学习式优化的人可以看看。#MAX-CUT#out-of-distribution generalizationaarXiv cs.AI@M. Harper Langston et al. (10)SourceRead laterReadWorth followingUsefulFollow MAX-CUT
PapersSelected10:51Chinese content超越事后温度缩放:用于LLM校准的双层优化这篇arxiv论文提出用双层优化做LLM校准,不靠事后温度缩放,在开放问答上分布外泛化更稳。#bilevel optimization#out-of-distribution generalizationaarXiv cs.LG@Ruochen Jin et al. (5)SourceRead laterReadWorth followingUsefulFollow bilevel optimization
Papers10:27Chinese contentIGA:通过不变梯度对齐提升推理蒸馏的鲁棒性做推理蒸馏或知识迁移的团队,IGA解决了小模型在分布外数据上泛化差的痛点,逻辑一致性提升四倍,值得在数学、医学等跨领域任务上试试。#reasoning distillation#out-of-distribution generalization#LoRAaarXiv cs.AI@Zehua Cheng et al. (3)SourceRead laterReadWorth followingUsefulFollow reasoning distillation