做生物影像分析的研究者终于有了一个能少标注、多任务的 3D 基础模型——少样本就能搞定分割、分类和去模糊，建议做 LSM 数据处理的团队直接试试开源的预训练权重。
该研究提出了一种针对光片荧光显微镜（LSM）的 3D 基础模型，通过在大规模多物种、多染色体的 3D 图像数据集上预训练，学习可迁移的体素表示。模型联合优化掩码重建和图像-文本对齐，显著降低了下游任务的标注需求，支持少样本分割、分类和去模糊。实验表明，该模型在标准指标和专家评估上均优于基线方法，展示了基础模型在 LSM 分析中减少标注负担并提升性能的潜力。代码和预训练权重已开源。
A Multimodal 3D Foundation Model for Light Sheet Fluorescence Microscopy Enables Few-Shot Segmentation, Classification, and Deblurring
Light sheet fluorescence microscopy (LSM) enables high-resolution, three-dimensional (3D) imaging of biological specimens, providing rich volumetric data for studying cellular organization, pathology, and vascular networks. However, the size, dimensionality, and annotation burden of LSM data make supervised deep learning approaches costly and difficult to scale. Additionally, despite the abundance of unannotated LSM volumes, foundation models for this modality remain underexplored due to computational challenges and the complexity of volumetric representation learning. In this work, we introduce a 3D foundation model for LSM data, pretrained on a large curated collection of 3D images spanning multiple organisms, stains, and imaging protocols. We learn transferable volumetric representations by jointly optimizing for masked reconstruction and image-text alignment. The pretrained backbone drastically reduces the annotation burden, enabling efficient, few-shot adaptation for varied downstream tasks. We evaluate this approach on downstream segmentation, classification, and deblurring. Our results demonstrate consistent improvements over baselines, (1) when measured using standard evaluation metrics and (2) when rigorously assessed by domain experts. This highlights the potential of foundation model pretraining to reduce annotation requirements while improving performance across diverse LSM analysis tasks. Pretrained model weights and code for pretraining and finetuning are publicly available: https://github.com/AdinaScheinfeld/lsm_fm_public_repo.git.