MITD-Net: Multi-scale iterative tamper detection network for image manipulation localization

被引:0
|
作者
Deng, Fan [1 ]
Yu, Haibo [1 ]
Liu, Tao [1 ]
Yang, Ruitao [1 ]
机构
[1] Xian Univ Sci & Technol, Sch Comp Sci & Technol, Xian 710054, Peoples R China
基金
中国国家自然科学基金;
关键词
Image manipulation localization; Attention mechanism; Multi-scale supervision; Multi-view feature learning; Edge distribution guidance;
D O I
10.1016/j.dsp.2024.104901
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Advancements in image tampering technology have escalated social risks and security challenges associated with tampered images. Accurately identifying tampered regions remains a significant challenge. To address the issue effectively, a multi-scale iterative tampering detection network is proposed, which decomposes the task into two phases, the Global-Local Feature Synchronization Phase and the Tampered Area Refinement Phase. Initially, dual-branch preprocessing and parallel feature extraction are employed. The Enhanced Downsampling Attention Block (EDAB) is introduced, and an Edge Enhancement Module (EEM) is implemented to extract edge features. Subsequently, Multi-Scale Dilated Convolution (MSDC) is utilized in the tampered area refinement phase, along with the proposed Pixel-level Feature Clustering Module (PFCM) and an iterative mechanism. Finally, incorporating a cross-scale fusion mechanism enables the synthesis of feature information from various scales, thereby enhancing the model's ability to detect subtle alterations in tampered regions. MITD-Net was validated on publicly available datasets, including CASIA, Columbia, COVERAGE, NIST 16, and IMD 20, achieving AUC scores of 84.5%, 98.5%, 85.8%, 86.6%, and 82.6%, respectively. Numerous experiments indicate that MITD-Net achieves higher detection accuracy, exhibits superior robustness, and can adapt to various tampering types and styles.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] MSCSCC-Net: multi-scale contextual spatial-channel correlation network for forgery detection and localization of JPEG-compressed image
    Wuyang Shan
    Jingchuan Yue
    Steven X. Ding
    Junying Qiu
    Scientific Reports, 15 (1)
  • [22] MSU-Net: the multi-scale supervised U-Net for image splicing forgery localization
    Yu, Hao
    Su, Lichao
    Dai, Chenwei
    Wang, Jinli
    PATTERN ANALYSIS AND APPLICATIONS, 2024, 27 (03)
  • [23] MFC-Net: Multi-scale fusion coding network for Image Deblurring
    Xia, Haiying
    Wu, Bo
    Tan, Yumei
    Tang, Xiaohu
    Song, Shuxiang
    APPLIED INTELLIGENCE, 2022, 52 (11) : 13232 - 13249
  • [24] AMS-Net: Adaptive Multi-Scale Network for Image Compressive Sensing
    Zhang, Kuiyuan
    Hua, Zhongyun
    Li, Yuanman
    Chen, Yongyong
    Zhou, Yicong
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 5676 - 5689
  • [25] MFC-Net: Multi-scale fusion coding network for Image Deblurring
    Haiying Xia
    Bo Wu
    Yumei Tan
    Xiaohu Tang
    Shuxiang Song
    Applied Intelligence, 2022, 52 : 13232 - 13249
  • [26] MLPN: Multi-Scale Laplacian Pyramid Network for deepfake detection and localization
    Zhang, Yibo
    Lin, Weiguo
    Xu, Junfeng
    Xu, Wanshang
    Xu, Yikun
    JOURNAL OF INFORMATION SECURITY AND APPLICATIONS, 2025, 89
  • [27] Multi-scale attention context-aware network for detection and localization of image splicing Efficient and robust identification network
    Ren, Ruyong
    Niu, Shaozhang
    Jin, Junfeng
    Zhang, Jiwei
    Ren, Hua
    Zhao, Xiaojie
    APPLIED INTELLIGENCE, 2023, 53 (15) : 18219 - 18238
  • [28] MAMA Net: Multi-Scale Attention Memory Autoencoder Network for Anomaly Detection
    Chen, Yurong
    Zhang, Hui
    Wang, Yaonan
    Yang, Yimin
    Zhou, Xianen
    Wu, Q. M. Jonathan
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (03) : 1032 - 1041
  • [29] Multi-manipulation Detection Network Combining Multi-scale Feature and Multi-branch Prediction
    Zhu X.
    Lu J.
    Gan Y.
    Ren H.
    Wang H.
    Xue J.
    Chen Y.
    Hunan Daxue Xuebao/Journal of Hunan University Natural Sciences, 2023, 50 (08): : 94 - 105
  • [30] SLMSF-Net: A Semantic Localization and Multi-Scale Fusion Network for RGB-D Salient Object Detection
    Peng, Yanbin
    Zhai, Zhinian
    Feng, Mingkun
    SENSORS, 2024, 24 (04)