MITD-Net: Multi-scale iterative tamper detection network for image manipulation localization

被引:0
|
作者
Deng, Fan [1 ]
Yu, Haibo [1 ]
Liu, Tao [1 ]
Yang, Ruitao [1 ]
机构
[1] Xian Univ Sci & Technol, Sch Comp Sci & Technol, Xian 710054, Peoples R China
基金
中国国家自然科学基金;
关键词
Image manipulation localization; Attention mechanism; Multi-scale supervision; Multi-view feature learning; Edge distribution guidance;
D O I
10.1016/j.dsp.2024.104901
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Advancements in image tampering technology have escalated social risks and security challenges associated with tampered images. Accurately identifying tampered regions remains a significant challenge. To address the issue effectively, a multi-scale iterative tampering detection network is proposed, which decomposes the task into two phases, the Global-Local Feature Synchronization Phase and the Tampered Area Refinement Phase. Initially, dual-branch preprocessing and parallel feature extraction are employed. The Enhanced Downsampling Attention Block (EDAB) is introduced, and an Edge Enhancement Module (EEM) is implemented to extract edge features. Subsequently, Multi-Scale Dilated Convolution (MSDC) is utilized in the tampered area refinement phase, along with the proposed Pixel-level Feature Clustering Module (PFCM) and an iterative mechanism. Finally, incorporating a cross-scale fusion mechanism enables the synthesis of feature information from various scales, thereby enhancing the model's ability to detect subtle alterations in tampered regions. MITD-Net was validated on publicly available datasets, including CASIA, Columbia, COVERAGE, NIST 16, and IMD 20, achieving AUC scores of 84.5%, 98.5%, 85.8%, 86.6%, and 82.6%, respectively. Numerous experiments indicate that MITD-Net achieves higher detection accuracy, exhibits superior robustness, and can adapt to various tampering types and styles.
引用
收藏
页数:15
相关论文
共 50 条
  • [31] Fusing Multi-scale Attention and Transformer for Detection and Localization of Image Splicing Forgery
    Xu, Yanzhi
    Zheng, Jiangbin
    Shao, Chenyu
    ADVANCES IN BRAIN INSPIRED COGNITIVE SYSTEMS, BICS 2023, 2024, 14374 : 335 - 344
  • [32] ManTra-Net: Manipulation Tracing Network For Detection And Localization of Image Forgeries With Anomalous Features
    Wu, Yue
    AbdAlmageed, Wael
    Natarajan, Premkumar
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 9535 - 9544
  • [33] An ensemble multi-scale residual attention network (EMRA-net) for image Dehazing
    Wang, Jixiao
    Li, Chaofeng
    Xu, Shoukun
    MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (19) : 29299 - 29319
  • [34] MTC-Net: Multi-scale feature fusion network for medical image segmentation
    Ren S.
    Wang Y.
    Journal of Intelligent and Fuzzy Systems, 2024, 46 (04): : 8729 - 8740
  • [35] MSRF-Net: A Multi-Scale Residual Fusion Network for Biomedical Image Segmentation
    Srivastava, Abhishek
    Jha, Debesh
    Chanda, Sukalpa
    Pal, Umapada
    Johansen, Havard
    Johansen, Dag
    Riegler, Michael
    Ali, Sharib
    Halvorsen, Pal
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2022, 26 (05) : 2252 - 2263
  • [36] MSAR-Net: A multi-scale attention residual network for medical image segmentation
    Li, Xiaoheng
    Chen, Cheng
    Chen, Yunqing
    Yu, Ming-an
    Xiao, Ruoxiu
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2025, 104
  • [37] MSHV-Net: A Multi-Scale Hybrid Vision Network for skin image segmentation
    Qu, Haicheng
    Gao, Yi
    Jiang, Qingling
    Wang, Ying
    DIGITAL SIGNAL PROCESSING, 2025, 162
  • [38] An ensemble multi-scale residual attention network (EMRA-net) for image Dehazing
    Jixiao Wang
    Chaofeng Li
    Shoukun Xu
    Multimedia Tools and Applications, 2021, 80 : 29299 - 29319
  • [39] Multi-scale iterative refinement network for RGB-D salient object detection
    Liu, Ze-Yu
    Liu, Jian-Wei
    Zuo, Xin
    Hu, Ming-Fei
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2021, 106
  • [40] Multi-Scale Difference Map Fusion for Tamper Localization Using Binary Ranking Hashing
    Yan, Cai-Ping
    Pun, Chi-Man
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2017, 12 (09) : 2144 - 2158