这项研究解决了高风险AI应用中模型过度自信的痛点,做可解释AI或安全关键系统的团队可以直接参考COCOCO框架来提升预测可靠性。
神经符号概念模型(NeSy-CBMs)结合神经网络与符号推理,适用于高风险场景,但其预测可能过于自信。研究者引入共形预测(CP)框架,提出三个理想目标:一致性、覆盖率和简洁性。现有方法无法同时满足这些目标,因此他们提出COCOCO,一种事后框架,联合共形化概念和标签,并通过演绎-溯因修正步骤协调两者。COCOCO满足所有三个目标,保持无分布覆盖率,对不完美知识具有鲁棒性,并支持用户指定的大小预算。在8个数据集上的实验表明,COCOCO在性能和集合大小方面优于竞争对手和基线方法。
Concise and Logically Consistent Conformal Sets for Neuro-Symbolic Concept-Based Models
Neuro-Symbolic Concept-based Models (NeSy-CBMs) are a family of architectures that integrate neural networks with symbolic reasoning for enhanced reliability in high-stakes applications. They work by first extracting high-level concepts from the input and then inferring a task label from these compatibly with given logical constraints. Yet, their label and concept predictions can be overconfident, making it difficult for stakeholders to gauge when the model's decisions can be trusted. We address this issue by integrating ideas from Conformal Prediction (CP), a framework providing rigorous, distribution-free coverage guarantees. We formalize three desiderata -- consistency, coverage, and conciseness -- that any conformal method for NeSy-CBMs should satisfy, and show that existing approaches fall short of at least one. We then introduce COCOCO, a post-hoc framework that conformalizes concepts and labels jointly and reconciles them via a single deduction-abduction revision step. COCOCO satisfies all three desiderata, retains distribution-free coverage, is robust to imperfect knowledge and supports user-specified size budgets. Our experiments on 8 data sets highlight how COCOCO compares favorably against competitors and natural baselines in terms of performance and set size.