CERS: CoT增强推理的半监督医学图像分割

Beyond Visual Cues: CoT-Enhanced Reasoning for Semi-supervised Medical Image Segmentation

精选理由

这篇论文用CoT推理帮医学图像分割识别病理不同的病变,比只看像素的旧方法靠谱得多,尤其是处理边界模糊的情况。

AI 摘要

提出CERS框架,将链式思维推理集成到半监督医学图像分割中,解决视觉-语义不匹配问题。利用大语言模型生成语言推理描述构建知识池,并设计语义感知参考选择策略,通过形态过滤和CoT一致性消除硬负样本。引入多尺度坐标注意力模块融合推理上下文,在多个基准上优于现有方法,尤其改善边界模糊和语义不一致。

原文 · arXiv cs.LG

Beyond Visual Cues: CoT-Enhanced Reasoning for Semi-supervised Medical Image Segmentation

Semi-supervised medical image segmentation has emerged as a dominant research problem in medical image analysis, mitigating annotation scarcity by leveraging consistency regularization on unlabeled data. However, existing approaches operate predominantly via visual pattern matching, relying heavily on pixel-level similarities. This visual-centric dependency often falters in clinical scenarios characterized by the visual-semantic mismatch, where visually similar lesions warrant distinct diagnostic conclusions, thus failing to capture the underlying diagnostic logic used by experts. To address this, we move beyond visual cues and propose CERS (CoT-Enhanced Reasoning Segmentation), a framework that integrates Chain-of-Thought (CoT) reasoning to distinguish pathologically distinct cases. Specifically, we construct a knowledge pool enriched with linguistic reasoning descriptions generated by large language models (LLMs). A semantic-aware reference selection strategy is introduced to identify historical evidence, filtering candidates first by morphology, and then refining them via CoT consistency to eliminate hard negatives. Furthermore, a multi-scale coordinate attention module (MCAM) is designed to effectively fuse this reasoning-derived context into the decoding process. Extensive experiments demonstrate the superiority of CERS against state-of-the-art approaches, particularly in resolving boundary ambiguities and semantic inconsistencies. The code is available at https://github.com/cymasuna/CERS.