COCOLogic-V2 这个新数据集专测视觉推理，正反例分类特别细，模型在近边界上直接翻车，做可解释 AI 的可以看看。
COCOLogic-V2 是一个面向现实图像的对象中心数据集，覆盖一阶逻辑的广泛子集，用于视觉归纳推理评估。它将样本分为正变体、近边界和远边界负例三类，实现对模型可解释性的细粒度诊断。实验表明，模型能很好区分正样本和远边界负例，但在近边界负例上表现失败。此外，感知噪声和大规则搜索空间在少样本场景下构成额外挑战。该数据集为推进视觉归纳推理提供了具体基础。
COCOLogic-V2: Identifying Logical Inconsistencies via Truly Hard-Negatives
While interpretable models such as concept bottleneck models (CBMs) and program synthesis methods enable verification of model decisions, their evaluation is typically limited to simple tasks, leaving complex reasoning on real-world images largely unexplored. We introduce COCOLogic-V2, an object-centric dataset for visual inductive reasoning on real-world images covering a broad subset of first-order logic. By categorizing samples into positive variants, near-boundary (NB), and far-from-boundary (FB) negatives, COCOLogic-V2 enables fine-grained diagnosis of model accountability. Our evaluations show that models tend to separate positive and FB samples well but fail on NB samples, while perceptual noise and large rule-induced search spaces pose additional challenges in few-shot settings. Together, these results highlight that visual inductive reasoning remains an open challenge and COCOLogic-V2 provides a concrete foundation for advancing methods in this direction.