图像篡改检测是 AI 安全的关键环节,AUDITS 为研究者提供了首个大规模多轴基准,做视觉取证或 AI 安全的人可以直接用它来评估和提升模型鲁棒性。
随着生成式 AI 的普及,图像篡改变得愈发容易,可能传播虚假信息。然而,现有研究缺乏针对不同视觉域中高级篡改的检测方法。为此,研究者提出了 AUDITS 基准,包含超过 53 万张来自用户和新闻照片的图像,利用扩散模型进行修复,支持对篡改类型、大小、质量及域迁移的多轴分析。实验评估了现有检测方法在不同域迁移下的鲁棒性,旨在推动更可靠、泛化的图像篡改检测研究。
Multi-axis Analysis of Image Manipulation Localization
Advanced image editing software enables easy creation of highly convincing image manipulations, which has been made even more accessible in recent years due to advances in generative AI. Manipulated images, while often harmless, could spread misinformation, create false narratives, and influence people's opinions on important issues. Despite this growing threat, there is limited research on detecting advanced manipulations across different visual domains. Thus, we introduce Analysis Under Domain-shifts, qualIty, Type, and Size (AUDITS), a comprehensive benchmark designed for studying axes of analysis in image manipulation detection. AUDITS comprises over 530K images from two distinct sources (user and news photos). We curate our dataset to support analysis across multiple axes using recent diffusion-based inpaintings, spanning a diverse range of manipulation types and sizes. We conduct experiments under different types of domain shift to evaluate robustness of existing image manipulation detection methods. Our goal is to drive further research in this area by offering new insights that would help develop more reliable and generalizable image manipulation detection methods.