这篇论文用VGG16和ResNet50跑MS-COCO，实测CRP和CRAFT两种解释方法，发现概念混淆和数据集偏见的具体规律，做可解释性研究值得看看。
该论文研究了概念可解释AI（CXAI）在多标签分类任务中的适用性，使用VGG16和ResNet50在MS-COCO数据集中标注最多的20个标签上训练模型。作者应用CRP和CRAFT两种CXAI方法生成概念级解释，发现CXAI能揭示DNN的学习弱点、更高概念区分度可减少标签与概念混淆、环境概念暴露数据集偏差。结果表明CXAI有助于诊断数据集引发的偏见并理解模型泛化能力。
Identifying Confusion Trends in Concept-based XAI for Multi-Label Classification
Deep Neural Networks (DNNs) deployed in high-risk domains, such as healthcare and autonomous driving, must be not only accurate but also understandable to ensure user trust. In real-world computer vision tasks, these models often operate on complex images containing background noise and are heavily annotated. To make such models explainable, Concept-based Explainable AI (CXAI) methods need to be assessed for their applicability and problem-solving capacity. In this work, we explore CXAI use cases in multi-label classification by training two DNNs, VGG16 and ResNet50, on the 20 most annotated labels in the MS-COCO dataset (Microsoft Common Objects in Context). We apply two CXAI methods, CRP (Concept Relevance Propagation) and CRAFT (Concept Recursive Activation FacTorization), to generate concept-level explanations and investigate the overall evaluations. Our analysis reveals three key findings: (1) CXAI highlights learning weaknesses in DNNs, (2) higher concept distinctiveness reduces label and concept confusion, and (3) environmental concepts expose dataset-induced biases. Our results demonstrate the potential of CXAI to enhance the understanding of model generalizability and to diagnose bias instigated by the dataset.