论文

FedOAG:异构无线网络中的空中联邦学习新算法

Over-the-Air Federated Learning in Heterogeneous Mobile Wireless Networks

精选理由

一篇通信方向的联邦学习论文,FedOAG 解决了弱信道拖累收敛、衰落模型失配的问题,理论证明了 O(1/√T) 最优速率,做边缘联邦学习可以看看。

论文提出 FedOAG,面向异构衰落信道下的空中联邦学习。该算法通过梯度归一化自动满足能量约束,并利用隐式 gossiping 均匀混合设备更新,不要求所有设备都参与传输,也不依赖特定衰落模型或时变信道分布知识。作者证明 FedOAG 收敛到无偏非凸目标的稳定点,达到随机一阶方法最优的 O(1/√T) 收敛率,并在真实数据集的动态无线条件下通过数值实验验证了分析结果。

原文 · arXiv cs.LG

Over-the-Air Federated Learning in Heterogeneous Mobile Wireless Networks

Over-the-air computation has emerged as a scalable and efficient solution for deploying federated learning algorithms in wireless networks by exploiting waveform superposition for simultaneous model aggregation. Most existing work struggles with heterogeneous fading channels. These approaches either enforce unbiased updates from all devices or allow partial device contributions, requiring careful tuning of the convergence bound to mitigate bias under specific fading models. However, the former significantly amplifies receiver noise due to the weakest channel, whereas the latter is sensitive to fading model mismatch and converges only to a biased objective. To tackle these challenges, we propose FedOAG, which employs algorithmic components to automatically satisfy energy constraints via gradient normalization and evenly mix devices' updates through implicit gossiping. Importantly, FedOAG does not require transmission from all devices, nor does it rely on a specific fading model or knowledge of time-varying statistical channel distributions. We show that FedOAG converges to a stationary point of an unbiased non-convex objective at the best possible rate $O(1/\sqrt{T})$ for any stochastic first-order method. We corroborate our analysis with numerical experiments over dynamic wireless conditions on real-world datasets.