这篇论文把GNN在数据分布变了之后到底准不准、慌不慌讲透了,还给出了一个不用标签的校准方法STAC,做图模型部署的值得一看。
这篇论文给出了图神经网络(GNN)在分布偏移下校准的第一个闭式理论表征,发现校准由单个标量决定,该标量依赖于源图与目标图之间的结构变化和特征质量。理论精确识别了模型何时过度自信、欠自信或保持校准,并直接导出了最优温度缩放策略。作者将分析扩展到对称归一化的图卷积网络、多分类和协变量偏移,导出了期望校准误差的理论上界。基于这些洞察提出了无需源域标签的STAC方法,在合成基准上校准显著提升,但在五个真实世界图数据集上不依赖目标标签的可靠校准仍具挑战。
When does distribution shift break graph neural networks calibration?
Graph neural networks (GNNs) are increasingly deployed in real-world applications where distribution shift is un-avoidable. However, how such shifts affect model calibration, defined as the agreement between predictive confidence and actual accuracy, remains poorly understood, and existing graph calibration methods typically rely on labeled validation data from the deployment distribution. In this work, I present the first closed-form theoretical characterization of GNN calibration under distribution shift. I show that calibration is governed by a single scalar quantity that explicitly depends on structural changes between the source and target graphs, as well as feature quality. This characterization precisely identifies when a model becomes over-confident, under-confident, or remains calibrated, and directly yields the optimal temperature scaling strategy. I further extend the analysis to graph convolutional networks with symmetric normalization, multi-class classification, and covariate shift, and derive a theoretical upper bound on the expected calibration error. My analysis also reveals that, under homogeneous distribution shift, a single global temperature is theoretically optimal, providing a principled explanation for why more complex node-wise recalibration methods offer no additional benefit. Building on these theoretical insights, I propose STAC, a source-free, label-free calibration method. Experiments on synthetic benchmarks demonstrate substantial calibration improvements, while evaluations on five real-world graph datasets show that reliable calibration without target labels remains challenging despite the strong predictive power of the theory.