这篇论文用病理数据预训练模型改进了FID/IS指标,发现比ImageNet特征更贴合下游分割任务,搞病理AI的值得看。
该论文评估了条件扩散模型生成的合成组织病理图像质量。研究发现传统FID和IS指标依赖ImageNet预训练特征,在病理图像上区分度有限。研究者提出用病理预训练基础模型改进FID和IS,并在四个基准数据集上训练条件扩散模型。改进后的IS与下游细胞核分割性能的相关系数为0.6096(p=0.0122),优于原始IS的0.0708。结果表明增加训练数据多样性比提升单图视觉保真度对分割模型更有帮助。
Assessment of Conditional Diffusion Model for Synthetic Histopathology Image Generation
Synthetic histopathology image generation has emerged as an approach that may address data scarcity in computational pathology, yet current evaluation methodologies may not fully assess synthetic data quality for medical applications. This work investigates and addresses limitations in existing evaluation metrics, investigating an approach for assessing synthetic histopathology image quality through domain-specific metrics and downstream task validation. We show that conventional synthetic data evaluation metrics such as Frechet Inception Distance (FID) and Inception Score (IS) may have limitations when applied to histopathology images due to their reliance on ImageNet-pretrained feature extractors. To address these limitations, we propose for consideration modified FID and IS approaches utilizing foundation models pretrained on digital pathology datasets, supplemented by precision-recall based metrics as part of an additional quality assessment. Using conditional denoising diffusion models trained on four benchmark datasets, with a two-step training approach, we generated synthetic datasets with systematically varied quality characteristics. We also measured the correlation between the synthetic data quality metrics with downstream nuclei segmentation performance using common metrics including the aggregated Jaccard index (AJI+) and the Dice coefficient. The study results suggest that pathology-specific metrics may provide improved discriminative power. Specifically, the modified Inception Score indicates higher correlation with downstream task performance (r=0.6096 with AJI+, p=0.0122), compared to the original IS (r=0.0708, p=0.7944). Our observations indicate that increasing the variety of generated training data has a higher positive correlation with segmentation model performance than improving the visual fidelity of individual generated images.