WALoMA：基于自适应低秩掩码自编码器的多任务无线基础模型
WALoMA: A Multitask Wireless Foundation Model via Adaptive Low-Rank Masked Autoencoders
这篇论文搞了个WALoMA，能用一个模型处理6G多个无线任务，只用少量标注数据就拿到87.8%的平均分，比LWM高了近28个百分点，参数只训练了14%。
WALoMA是一种针对6G无线物理层的多任务基础模型，采用掩码自编码器（MAE）范式从未标记信道数据中学习。它使用2D位置编码保留天线与子载波间空间频率关系，并通过低秩适应（LoRA）实现参数高效微调。
在五个下游任务中，WALoMA分别达到96.47%（LoS/NLoS分类）、80.
45%（波束预测）、85.78%（信道插值）、99.
12%（信道估计）和77.18%（信道映射）。
其复合分数87.80%，大幅超越大无线模型（LWM）的59.
90%，且仅训练14.68%的总参数。
即使在标注数据极端稀缺条件下仍保持强性能。
WALoMA: A Multitask Wireless Foundation Model via Adaptive Low-Rank Masked Autoencoders
This paper proposes a multitask wireless foundation model via adaptive low-rank masked autoencoders (WALoMA), a unified multi-task foundation model for sixth-generation (6G) wireless physical layer architectures, to address the limitations of specialized, task-specific deep learning models and the practical challenge of scarce labeled wireless datasets. By leveraging concepts inspired by foundation models, the proposed framework adopts a masked autoencoder (MAE) paradigm to learn from unlabeled channel data, to significantly reduce reliance on extensive annotations. The model treats wireless channel state information (CSI) as a universal modality and learns transferable representations through self-supervised channel reconstruction. Key architectural novelties include the use of 2D positional encoding (PE) to explicitly preserve the spatial-frequency relationships between antennas and subcarriers, and low-rank adaptation (LoRA) for parameter-efficient fine-tuning. The framework's efficacy is demonstrated across five downstream tasks, achieving individual scores of 96.47\% for LoS/NLoS classification, 80.45\% for beam prediction, 85.78\% for channel interpolation, 99.12\% for channel estimation, and 77.18\% for channel charting. Consequently, numerical results show that the proposed model achieves a composite score of 87.80\%, significantly outperforming the 59.90\% achieved by the large wireless model (LWM) baseline while training an average of only 14.68\% of total parameters, and maintaining strong performance even under extremely limited labeled data conditions.
This report is categorized under AITOP's "Papers" desk. Key entities and technical topics under continuous tracking include WALoMA, 6G, LoRA, 无线基础模型.
Source attribution: curated from arXiv cs.LG (@Madi Makin, Asmaa Abdallah, Abdulkadir Celik, Ahmed M. Eltawil).