这篇文章用加噪声的办法治GNN过平滑,从数学上给你保证不塌缩,还和残差连接、归一化这些老办法做了对比。
该论文研究向循环图神经网络每步传播后注入独立高斯噪声的架构,并将其分析为随机动力系统。在标准全局收缩假设下,作者证明隐藏表示构成几何遍历的马尔可夫链,存在唯一不变概率测度。主要理论结果给出平稳状态Dirichlet能量的显式正下界,该下界与噪声方差和图的谱间隙成正比。这从理论上保证了平稳表示不会塌缩到常量流形,即渐近过平滑被严格防止。实验在线性和非线性循环GNN上验证了理论预测,呈现稳态分布及能量对噪声强度的依赖关系。
Persistent Gaussian Perturbations Prevent Oversmoothing in Recurrent Graph Neural Networks
Oversmoothing is a fundamental limitation of deep graph neural networks (GNNs), where repeated message passing causes node representations to become increasingly similar, eventually collapsing toward a low-dimensional subspace. This phenomenon limits the effective depth of message-passing architectures and motivates the search for mechanisms that preserve representation diversity. In this paper, we study a recurrent graph neural network in which independent Gaussian noise is injected after every propagation step and analyze the resulting architecture as a stochastic dynamical system. Under a standard global contraction assumption on the deterministic update, we prove that the hidden representations form a geometrically ergodic Markov chain admitting a unique invariant probability measure. Our main theoretical result establishes an explicit positive lower bound on the expected stationary Dirichlet energy, proportional to both the noise variance and the spectral gap of the underlying graph. Consequently, the stationary representations cannot collapse onto the constant manifold, providing a rigorous guarantee that asymptotic oversmoothing is prevented in the sense of non-vanishing Dirichlet energy. Our analysis reveals persistent stochastic perturbations as a fundamentally different mechanism for combating oversmoothing, complementing existing deterministic approaches based on residual connections, normalization, and graph rewiring. Finally, numerical experiments on both linear and nonlinear recurrent graph neural networks closely match the theoretical predictions, illustrating the emergence of a stationary distribution and the predicted dependence of the limiting Dirichlet energy on the noise intensity.