论文

AURA 元学习框架:在潜空间用贝叶斯滤波实现快速在线学习

Online Learning via Learned Latent Bayesian Tracking

精选理由

一篇把在线学习拆成潜空间卡尔曼滤波的论文,AURA 单步就能适配新分布,做流式数据自适应的可以看看。

论文提出 AURA,一种元学习框架,离线学习一个低维潜状态空间模型来描述分布偏移下最优参数的演化。在线阶段在该潜空间执行扩展卡尔曼滤波,再通过学习到的提升映射重建完整模型参数,实现单步自适应。在时变信道下的神经无线接收机在线适配和非平稳图像分类两项任务上,AURA 在适应速度、准确率和计算效率上均超过现有在线学习与贝叶斯滤波基线。

原文 · arXiv cs.LG

Online Learning via Learned Latent Bayesian Tracking

Online learning in non-stationary environments requires models to adapt rapidly from streaming data under strict computational constraints. A principled approach casts online learning as Bayesian state tracking, where model parameters are updated sequentially via Bayesian filtering. However, applying Bayesian filters directly to modern deep models is computationally prohibitive due to the high dimensionality of parameter space, forcing existing methods to rely on restrictive approximations or manually designed low-dimensional subspaces. In this work, we identify the absence of a suitable low-dimensional dynamical representation as the core bottleneck in Bayesian filtering-based online learning. Accordingly, we propose Adaptive Update through Representation Adaptation (AURA), a meta-learning framework that learns offline a low-dimensional latent state-space model governing the evolution of optimal model parameters under distribution shift. Online adaptation is then performed via extended Kalman filtering in this learned latent space followed by reconstruction of the full model parameters through a learned lifting map, enabling efficient single-step online adaptation while preserving model expressiveness. Evaluated on online adaptation of neural wireless receivers under time-varying channels and on non-stationary image classification, AURA shows substantial improvements in adaptation speed, accuracy, and computational efficiency over existing online learning and Bayesian filtering baselines, demonstrating that an adaptation-aware latent geometry is beneficial for effective Bayesian online learning in high-dimensional models.