这篇论文为理解神经网络预测提供了更精确的理论工具，做机器学习理论或模型可解释性研究的开发者值得关注，能帮你更深入理解训练数据的影响机制。
本文提出了机器学习中二阶路径核插值公式，扩展了Pedro Domingos在2020年提出的一阶插值公式。该公式将模型预测表示为沿优化路径的积分，其中包含数据依赖的核函数。二阶形式补充了曲率加权的插值项，对于随机梯度下降，还出现了与mini-batch梯度噪声协方差耦合的采样诱导分量。研究还扩展到带动量的随机梯度下降，并给出了终端预测的浓度估计。这些结果细化了神经网络预测的路径核解释，为理解训练数据如何塑造模型预测提供了更精确的理论框架。
Second-Order Path Kernel Interpolation Formulas in Machine Learning
Understanding how training data shape neural network predictions is a central problem in modern learning theory. In 2020, Pedro Domingos proposed an interpolation formula valid for every model learned by deterministic gradient descent. It expresses the model's prediction as an integral, along the optimization path, of a data-dependent kernel that aligns the model's gradients at the test and training data. Such a first-order characterization remains valid for models trained with batch-based stochastic optimization. In this paper, we develop second-order forms of these interpolation formulas. We show that the leading path-kernel interpolation is supplemented by a curvature-weighted interpolation term. For stochastic gradient descent, an additional sampling-induced component appears, coupling the curvature of the prediction with the covariance of mini-batch gradient noise. We also extend the representation to stochastic gradient descent with momentum, where the interpolation structure is preserved but with the weights modified by a memory-related factor. Moreover, we establish a concentration estimate for the terminal prediction, identifying the fluctuation scale around the expected second-order representation. Together, these results provide a refinement of the path-kernel interpretation of neural network prediction.