ECMWF 提出批量 NN 4D-Var 框架,让数值天气预报系统在线学习误差修正
Batched NN 4D-Var: a performant hybrid model framework for the Integrated Forecasting System
ECMWF 把神经网络塞进 4D-Var 里在线学模式误差,顺序学习过拟合、批量版能泛化,做气象 AI 的人可以看看这套训练思路。
ECMWF 团队在 Integrated Forecasting System(IFS)中用神经网络表示模式误差,并通过 4D-Var 数据同化循环直接从观测训练网络参数。实验在中等分辨率下比较了两种在线学习方式:仅估神经网络参数的顺序学习在训练期内将预报误差降低超过 10%,但无法泛化到未见数据。新提出的批量方法借鉴 mini-batch 随机优化,随机处理多个同化窗口并平均参数增量,在样本外实验中持续提升预报技巧。诊断显示在线训练的修正保持了真实的预报变率,没有靠人工平滑换取精度。
Batched NN 4D-Var: a performant hybrid model framework for the Integrated Forecasting System
Hybrid forecasting systems combining machine learning and numerical weather prediction offer a promising route toward improved forecast skill while preserving physical consistency. In this study, we investigate online learning of state-dependent model-error corrections within the Integrated Forecasting System using 4D-Var. Building on previous work, we represent model error using a neural network embedded within the forecast model and trained from observations through the data assimilation cycle. First, we introduce a targeted variant of neural-network 4D-Var in which only the neural-network parameters are estimated, while the atmospheric state is provided by a precomputed analysis. We then propose a batched extension that processes assimilation windows in random order and averages parameter increments over multiple windows, drawing inspiration from mini-batch stochastic optimization. Experiments are conducted with the Integrated Forecasting System of the European Centre for Medium-Range Weather Forecasts at an intermediate resolution. Sequential online learning substantially improves forecasts within the training period, with error reductions exceeding 10%in some cases. However, these improvements fail to generalize to unseen data. In contrast, the proposed batched formulation produces hybrid models that consistently improve forecast skill in out-of-sample experiments. Larger batch sizes accelerate convergence and improve robustness by reducing the noise of parameter updates. Diagnostics further show that the online-trained corrections preserve realistic forecast variability and do not improve skill through artificial smoothing. These results demonstrate that the formulation of the online learning problem is critical for generalisation and establish batched online training as a promising framework for hybrid machine-learning/data-assimilation systems.