Models

InnerLogic-Surg 开源手术视觉基础模型,20 项任务全部领先

InnerLogic-Surg: An Open Surgical Foundation Model via Continual Pretraining

Why we picked it

外科手术版的 DINOv3,用近 2900 小时手术视频训练出的开源视觉编码器,20 个手术任务全胜,做医疗影像的可以拿来当 backbone。

研究团队发布开源手术视觉编码器家族 InnerLogic-Surg,参数规模 21M–300M。模型在来自 11,965 段手术视频(约 2,900 小时、超过十五种术式)的数百万张手术图像上做持续预训练,训练方案继承 DINOv3 的预训练阶段以保留表征能力。在覆盖工作流、器械与解剖结构识别、分割、检测和单目深度的基准上,最大模型在全部 20 项手术任务的 linear-probe 测试中拿到最佳成绩。

Original · arXiv cs.AI

InnerLogic-Surg: An Open Surgical Foundation Model via Continual Pretraining

Vision foundation models are the backbone of modern surgical image analysis, yet most surgical systems still rely on encoders pretrained on natural images or on specialist models trained from scratch on comparatively small datasets. Pretraining encoders on large amounts of surgery-specific data has the potential to generally enhance the performance of surgical image analysis methods simply by providing stronger backbones. Here we present InnerLogic-Surg, an open family of surgical vision encoders (21M--300M parameters) obtained by continually pretraining a transformer-based image encoder on millions of surgical images curated from 11,965 internet-sourced surgical videos spanning ~2,900 hours and more than fifteen procedure types. Our training recipe inherits DINOv3's pretraining stage to preserve representation ability after surgical adaptation, and additionally applies a learned feature-upsampling module for high-resolution dense prediction at low token cost. Across a benchmark covering workflow, instrument and anatomy recognition, segmentation, detection, and monocular depth, under the same architecture, the largest InnerLogic-Surg model achieves the best linear-probe performance in all 20 surgical tasks. We demonstrate that surgical continual pretraining yields transferable representations that generalize across procedures, anatomical regions, and task types, showing our surgical image encoders as a promising and scalable alternative to the procedure-specific representation learning approaches that have traditionally dominated surgical computer vision.