论文

粗网格 FDM 谱引导神经网络求解特征值,迭代减少八到十倍

Low-Fidelity FDM Spectral Guidance for Neural Eigenvalue Solvers

精选理由

算特征值不用再二选一:先用粗网格 FDM 算个大概,再拿它当偏移去训练神经网络,迭代直接省八到十倍,做科学计算的建议看看。

一篇 arXiv 论文提出用粗网格有限差分法(FDM)近似算子谱,把得到的特征值作为固定偏移用于神经网络求解器的训练,降低找错特征值的风险。作者还提出 SIPMNN(Stabilized Inverse Power Method Neural Network),一种面向高维问题的更稳定训练流程。在 d=10 的五个测试问题上,混合方法比测试过的纯神经方法整体更准确,且训练迭代次数减少八到十倍,突破了纯神经方法动辄数十万步训练的成本瓶颈。

原文 · arXiv cs.LG

Low-Fidelity FDM Spectral Guidance for Neural Eigenvalue Solvers

Operator eigenvalue problems appear throughout science. Classical methods usually discretize the operator into a matrix and then solve the resulting matrix eigenvalue problem. This works well in low dimensions, but fine grids quickly become expensive in both memory and computation as the dimension grows. Neural network based solvers avoid storing these large grids, but recent state of the art neural methods can require hundreds of thousands of training steps and may struggle to find the desired eigenvalues. We show that the two approaches can help each other. A coarse finite difference method (FDM) calculation acts as a cheap numerical model of the operator spectrum. We use the approximate eigenvalues as fixed shifts during the training of the neural solver, as they only need to locate the relevant part of the spectrum. We also introduce Stabilized Inverse Power Method Neural Network (SIPMNN), a more stable training procedure for higher-dimensional problems. Across five test problems at $d=10$, the combined approach is more accurate overall than the tested fully neural alternatives while using eight to ten times fewer iterations.