简单域泛化实现VLM像素级图像篡改检测

Simple Domain Generalization for Strong Pixel-Level Image Tampering Detection in Modern VLMs

精选理由

他们用两个简单技巧,让检测AI改图的模型在GPT、Gemini等新模型上比之前最好的PIXAR强了26%多,代码也开源了,搞图像安全的可以试试。

AI 摘要

本研究针对ChatGPT、Gemini、Qwen-Image等现代VLM的像素级图像篡改检测,提出简单域泛化训练框架,包含平衡小批量采样和后期注入策略。在OOD VLM(GPT-Images-2.0、Gemini-3.1、FLUX.2、Seedream 4.5)上,该方法相比先前最优PIXAR,平均gIoU和cIoU分别相对提升26.1%和26.8%。代码已开源于GitHub。

原文 · arXiv cs.AI

Simple Domain Generalization for Strong Pixel-Level Image Tampering Detection in Modern VLMs

Modern vision-language models (VLMs) have significantly improved image generation and editing capabilities, making pixel-level image tampering detection increasingly important yet challenging under cross-model and out-of-distribution shifts. This work studies domain generalization for pixel-level image tampering detection in modern VLMs like ChatGPT, Gemini, Qwen-Image, etc., aiming to learn tampering localization models that remain robust across diverse VLM-generated manipulation distributions. We propose a simple yet effective domain-generalized training framework built on two practical strategies. First, we introduce a balanced minibatch sampling scheme that strategically samples tampered and real images in each minibatch, preventing biased optimization toward either manipulated artifacts or clean-image priors and avoiding training collapse, ensuring that each optimization step receives proper sampled gradient signals. Second, we adopt a simple late-injection strategy, where the detector is first trained on large-scale base data until stable convergence, and then exposed to a small amount of newly selected supporting data from emerging VLM distributions, improving adaptability without overfitting to limited new domains. Together, these components provide a simple yet strong recipe for improving pixel-level tampering localization and OOD robustness across modern VLMs. Despite the conceptual simplicity, our framework outperforms the prior state-of-the-art PIXAR by a large margin of 26.1% and 26.8% relative improvement in average gIoU and cIoU, respectively, across OOD VLMs of GPT-Images-2.0, Gemini-3.1, FLUX.2, and Seedream 4.5. Our code is available at https://github.com/VILA-Lab/PIXAR-DG