A New Benchmark and Model for Challenging Image Manipulation Detection

Authors

  • Zhenfei Zhang University at Albany, SUNY
  • Mingyang Li McGill University
  • Ming-Ching Chang University at Albany, SUNY

DOI:

https://doi.org/10.1609/aaai.v38i7.28571

Keywords:

CV: Adversarial Attacks & Robustness

Abstract

The ability to detect manipulation in multimedia data is vital in digital forensics. Existing Image Manipulation Detection (IMD) methods are mainly based on detecting anomalous features arisen from image editing or double compression artifacts. All existing IMD techniques encounter challenges when it comes to detecting small tampered regions from a large image. Moreover, compression-based IMD approaches face difficulties in cases of double compression of identical quality factors. To investigate the State-of-The-Art (SoTA) IMD methods in those challenging conditions, we introduce a new Challenging Image Manipulation Detection (CIMD) benchmark dataset, which consists of two subsets, for evaluating editing-based and compression-based IMD methods, respectively. The dataset images were manually taken and tampered with high-quality annotations. In addition, we propose a new two-branch network model based on HRNet that can better detect both the image-editing and compression artifacts in those challenging conditions. Extensive experiments on the CIMD benchmark show that our model significantly outperforms SoTA IMD methods on CIMD. The dataset is available at: https://github.com/ZhenfeiZ/CIMD.

Published

2024-03-24

How to Cite

Zhang, Z., Li, M., & Chang, M.-C. (2024). A New Benchmark and Model for Challenging Image Manipulation Detection. Proceedings of the AAAI Conference on Artificial Intelligence, 38(7), 7405–7413. https://doi.org/10.1609/aaai.v38i7.28571

Issue

Section

AAAI Technical Track on Computer Vision VI