这篇论文搞了个WALoMA，能用一个模型处理6G多个无线任务，只用少量标注数据就拿到87.8%的平均分，比LWM高了近28个百分点，参数只训练了14%。
WALoMA是一种针对6G无线物理层的多任务基础模型，采用掩码自编码器（MAE）范式从未标记信道数据中学习。它使用2D位置编码保留天线与子载波间空间频率关系，并通过低秩适应（LoRA）实现参数高效微调。在五个下游任务中，WALoMA分别达到96.47%（LoS/NLoS分类）、80.45%（波束预测）、85.78%（信道插值）、99.12%（信道估计）和77.18%（信道映射）。其复合分数87.80%，大幅超越大无线模型（LWM）的59.90%，且仅训练14.68%的总参数。即使在标注数据极端稀缺条件下仍保持强性能。
WALoMA: A Multitask Wireless Foundation Model via Adaptive Low-Rank Masked Autoencoders
This paper proposes a multitask wireless foundation model via adaptive low-rank masked autoencoders (WALoMA), a unified multi-task foundation model for sixth-generation (6G) wireless physical layer architectures, to address the limitations of specialized, task-specific deep learning models and the practical challenge of scarce labeled wireless datasets. By leveraging concepts inspired by foundation models, the proposed framework adopts a masked autoencoder (MAE) paradigm to learn from unlabeled channel data, to significantly reduce reliance on extensive annotations. The model treats wireless channel state information (CSI) as a universal modality and learns transferable representations through self-supervised channel reconstruction. Key architectural novelties include the use of 2D positional encoding (PE) to explicitly preserve the spatial-frequency relationships between antennas and subcarriers, and low-rank adaptation (LoRA) for parameter-efficient fine-tuning. The framework's efficacy is demonstrated across five downstream tasks, achieving individual scores of 96.47\% for LoS/NLoS classification, 80.45\% for beam prediction, 85.78\% for channel interpolation, 99.12\% for channel estimation, and 77.18\% for channel charting. Consequently, numerical results show that the proposed model achieves a composite score of 87.80\%, significantly outperforming the 59.90\% achieved by the large wireless model (LWM) baseline while training an average of only 14.68\% of total parameters, and maintaining strong performance even under extremely limited labeled data conditions.