PapersSelected

Physics-Informed Training Framework Uses Neural Operators to Avoid Bad Minima

Learning Physics from an Imperfect Ancestor

Why we picked it

An imperfect neural operator only needs to place a PINN in the right solution basin, a practical recipe for anyone solving PDEs in engineering or research where labeled data is scarce and out-of-distribution accuracy matters.

A three-stage framework freezes the spatial basis of a physics-informed neural operator, extrapolates its solution branch to an out-of-distribution parameter via a polynomial continuation prior, and distills the result into a fresh PINN. Evaluation covers three nonlinear PDEs: 1D viscous Burgers, 2D steady Allen-Cahn, and 2D steady lid-driven cavity flow. On Allen-Cahn, a standard PINN collapses to the trivial zero branch while the distilled model recovers the non-trivial branch matching a finite-difference reference. For the lid-driven cavity at Reynolds number Re = 3200, the method accelerates convergence to the correct physical state with fewer parameters and optimization steps than recent literature baselines.

Original · arXiv cs.LG

Learning Physics from an Imperfect Ancestor

Neural operators evaluate parametric partial differential equations cheaply but degrade sharply outside their training distribution. Physics-informed neural networks avoid dependence on labeled data, yet their optimization can be basin-fragile: when the governing residual admits multiple solutions, a PINN trained from scratch may converge to a physically incorrect state despite achieving a small residual. We show that these failure modes can be addressed jointly: an imperfect NO provides the structural prior needed to place a PINN in the correct solution basin, while the PDE residual refines the solution beyond the operator's accuracy. We introduce a three-stage framework that freezes the spatial basis of a physics-informed NO, extrapolates its solution branch to an out-of-distribution parameter using a polynomial continuation prior, and distills the resulting field into a fresh PINN. The NO need not be accurate at the target; it transfers solution-branch information, while PDE residual minimization in the PINN governs convergence. We evaluate the framework on three nonlinear PDEs: 1D viscous Burgers, 2D steady Allen-Cahn near a pitchfork bifurcation, and 2D steady lid-driven cavity flow. For Allen-Cahn, where the trivial solution satisfies the PDE residual exactly, a standard PINN collapses to the trivial zero branch, whereas distillation from the crude extrapolated operator recovers the non-trivial branch that matches the finite-difference reference. For the lid-driven cavity, extrapolating to a Reynolds number of Re = 3200 accelerates convergence to the correct physical state, achieving competitive accuracy using fewer parameters and optimization steps than recent literature baselines. These results establish a simple principle: an NO need not accurately predict the solution to be useful; it only needs to identify the correct basin from which PINN optimization can recover it.