MITD-Net: Multi-scale iterative tamper detection network for image manipulation localization

被引:0
|
作者
Deng, Fan [1 ]
Yu, Haibo [1 ]
Liu, Tao [1 ]
Yang, Ruitao [1 ]
机构
[1] Xian Univ Sci & Technol, Sch Comp Sci & Technol, Xian 710054, Peoples R China
基金
中国国家自然科学基金;
关键词
Image manipulation localization; Attention mechanism; Multi-scale supervision; Multi-view feature learning; Edge distribution guidance;
D O I
10.1016/j.dsp.2024.104901
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Advancements in image tampering technology have escalated social risks and security challenges associated with tampered images. Accurately identifying tampered regions remains a significant challenge. To address the issue effectively, a multi-scale iterative tampering detection network is proposed, which decomposes the task into two phases, the Global-Local Feature Synchronization Phase and the Tampered Area Refinement Phase. Initially, dual-branch preprocessing and parallel feature extraction are employed. The Enhanced Downsampling Attention Block (EDAB) is introduced, and an Edge Enhancement Module (EEM) is implemented to extract edge features. Subsequently, Multi-Scale Dilated Convolution (MSDC) is utilized in the tampered area refinement phase, along with the proposed Pixel-level Feature Clustering Module (PFCM) and an iterative mechanism. Finally, incorporating a cross-scale fusion mechanism enables the synthesis of feature information from various scales, thereby enhancing the model's ability to detect subtle alterations in tampered regions. MITD-Net was validated on publicly available datasets, including CASIA, Columbia, COVERAGE, NIST 16, and IMD 20, achieving AUC scores of 84.5%, 98.5%, 85.8%, 86.6%, and 82.6%, respectively. Numerous experiments indicate that MITD-Net achieves higher detection accuracy, exhibits superior robustness, and can adapt to various tampering types and styles.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] Image Tamper Detection and Multi-Scale Self-Recovery Using Reference Embedding with Multi-Rate Data Protection
    Daneshmandpour, Navid
    Danyali, Habibollah
    Helfroush, Mohammad Sadegh
    CHINA COMMUNICATIONS, 2019, 16 (11) : 154 - 166
  • [42] Image Tamper Detection and Multi-Scale Self-Recovery Using Reference Embedding with Multi-Rate Data Protection
    Navid Daneshmandpour
    Habibollah Danyali
    Mohammad Sadegh Helfroush
    中国通信, 2019, 16 (11) : 154 - 166
  • [43] CP-Net: Multi-Scale Core Point Localization in Fingerprints Using Hourglass Network
    Arora, Geetika
    Kumbhat, Arsh
    Bhatia, Ashutosh
    Tiwari, Kamlesh
    2023 11TH INTERNATIONAL WORKSHOP ON BIOMETRICS AND FORENSICS, IWBF, 2023,
  • [44] Multi-Scale Attention Network for Image Cropping
    Lian, Tianpei
    Xian, Ke
    Pan, Zhiyu
    Hong, Chaoyi
    Cao, Zhiguo
    Zhong, Weicai
    2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 2640 - 2645
  • [45] Image steganalysis with multi-scale residual network
    Hao Chen
    Qi Han
    Qiong Li
    Xiaojun Tong
    Multimedia Tools and Applications, 2023, 82 : 22009 - 22031
  • [46] MULTI-SCALE RESIDUAL NETWORK FOR IMAGE CLASSIFICATION
    Zhong, Xian
    Gong, Oubo
    Huang, Wenxin
    Yuan, Jingling
    Ma, Bo
    Li, Ryan Wen
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 2023 - 2027
  • [47] Image steganalysis with multi-scale residual network
    Chen, Hao
    Han, Qi
    Li, Qiong
    Tong, Xiaojun
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (14) : 22009 - 22031
  • [48] The Multi-scale Fast Network For Image Superresolution
    Duan, Yongsheng
    Su, Yang
    Wu, Wei
    Wang, Han
    Xu, Jiahao
    PROCEEDINGS OF 2019 IEEE 9TH INTERNATIONAL CONFERENCE ON ELECTRONICS INFORMATION AND EMERGENCY COMMUNICATION (ICEIEC 2019), 2019, : 192 - 195
  • [49] Multi-scale attention network for image inpainting
    Qin, Jia
    Bai, Huihui
    Zhao, Yao
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2021, 204
  • [50] Generalized multi-scale image decomposition for new tone manipulation
    Guanlei, Xu
    Xiaogang, Xu
    Xiaotong, Wang
    DIGITAL SIGNAL PROCESSING, 2023, 135