OOD退化预测研究：源训练动力学可提前预警
Prospective Prediction of OOD Degradation from Source-Side Training Dynamics
这篇论文发现源训练动力学能提前预警未来OOD失效，对模型鲁棒性研究有实用价值。
研究人员探索能否仅通过源域训练动力学预测未见过分布(OOD)的持续退化。在捷径学习设置中，逻辑回归预测器展现出明确的前瞻信号，而训练时间单独则不具备此能力。源域量的时间摘要比当前值更具信息量。从CNN转移到MLP时，置信度和熵动力学保留大量预测信息。
Prospective Prediction of OOD Degradation from Source-Side Training Dynamics
We study whether persistent out-of-distribution (OOD) degradation can be predicted before it is directly observed using only source-side training dynamics. In a controlled shortcut-learning setting, a simple logistic regression predictor develops a clear prospective signal, while training time alone does not. Temporal summaries of the source-side quantities are substantially more informative than their current values. When transferred without additional training from a CNN to an MLP, confidence and entropy dynamics retain substantial predictive information. These results provide a proof of principle that source-side training dynamics can contain an early warning signal for future OOD failure.
