做工业检测或产品分拣的团队,终于有专门针对混合物体场景的计数数据集了——用自动生成流水线解决标注难题,直接训练就能让模型在真实场景中MAE降20%,值得一试。
现有目标计数模型在混合物体场景中表现不佳,而真实数据集标注成本高且存在噪声,合成数据集又缺乏多样性和真实性。为此,研究者推出了MixCount数据集和基准测试,通过自动生成流水线合成图像、细粒度文本描述和像素级计数标注,解决了标注歧义问题。在MixCount上评估现有模型,发现其性能在混合场景下严重下降。但用MixCount数据训练后,模型在FSC-147和PairTally基准上的平均绝对误差分别降低20.14%和18.3%。这表明MixCount不仅能作为基准测试,还能提供近乎无限的标注数据,突破计数模型长期面临的数据瓶颈。
The MixCount Dataset: Bridging the Data Gap for Open-Vocabulary Object Counting
Object counting is a foundational vision task with over a decade of dedicated research, yet state-of-the-art models still fail systematically in the mixed-object setting that dominates real-world applications such as industrial inspection and product sorting. We show that this gap is strongly driven by limitations in existing training and evaluation data: real counting datasets are prohibitively expensive to annotate and suffer from labeling noise, while existing synthetic alternatives lack diversity and realism. We address this with MixCount, a dataset and benchmark for mixed-object counting designed to target the failure modes of current counting models. To overcome the high cost of constructing and labeling such data, we develop an automatic generation pipeline that synthesizes images, fine-grained textual descriptions, and pixel-perfect counting annotations at scale, eliminating the labeling ambiguity that plagues prior datasets. Evaluating state-of-the-art counting models on MixCount exposes severe degradation in the mixed-object setting. More importantly, training these models on our synthesized data yields substantial gains on real-world benchmarks, reducing MAE by 20.14% on FSC-147 and by 18.3% on PairTally. These results establish MixCount as both a benchmark and a training dataset for fine-grained counting, and demonstrate that our pipeline, which produces effectively unlimited labeled data, helps address a long-standing bottleneck in counting models.