Image tampering localization network based on multi-class attention and progressive subtraction

被引:0
|
作者
Shao, Yunxue [1 ]
Dai, Kun [1 ]
Wang, Lingfeng [2 ,3 ]
机构
[1] Nanjing Tech Univ, Coll Artif Intelligence, Nanjing 211816, Peoples R China
[2] Weiqiao UCAS Sci & Technol Pk, Binzhou Inst Technol, Binzhou 256606, Peoples R China
[3] Beijing Univ Chem Technol, Coll Informat Sci & Technol, Beijing 100029, Peoples R China
基金
中国国家自然科学基金;
关键词
Image tampering localization; EMER modules; Progressive subtraction; Shift operation;
D O I
10.1007/s11760-024-03622-2
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Image tamper localization is an important research topic in the field of computer vision, which aims at identifying and localizing human-modified regions in images. In this paper, we propose a new image tampering localization network, which is named MAPS-Net. It combines the advantages of efficient multi-scale attention, shift operation, and progressive subtraction, which not only improves the sensitivity and generalization to novel data tampering behaviors but also significantly reduces the computation time. MAPS-Net consists of upper and lower branches, which are the fake edge-enhancing branch and the interfering factors-weakening branch. The fake edge-enhancing branch uses an efficient multi-scale edge residual module to enhance the expressiveness of the features, while the interfering factors-weakening branch uses progressive subtraction to weaken the interference of image content fluctuations in capturing general tampering behaviors. Finally, the features of both branches are fused with a position attention mechanism via a shift operation to capture the spatial relationships between different views. Experiments conducted on several publicly available datasets show that MAPS-Net outperforms existing mainstream models in both image tampering detection and localization, especially in image tampering localization in real scenes. Code is available at: https://github.com/dklive1999/MAPS-Net.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] Weber Law Based Approach for Multi-Class Image Forgery Detection
    Akram, Arslan
    Rashid, Javed
    Jaffar, Arfan
    Hajjej, Fahima
    Iqbal, Waseem
    Sarwar, Nadeem
    CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 78 (01): : 145 - 166
  • [42] Adaptive multi-class metric content-based image retrieval
    Peng, J
    ADVANCES IN VISUAL INFORMATION SYSTEMS, PROCEEDINGS, 2000, 1929 : 407 - 418
  • [43] Unsupervised Multi-Class Joint Image Segmentation
    Wang, Fan
    Huang, Qixing
    Ovsjanikov, Maks
    Guibas, Leonidas J.
    2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 3142 - 3149
  • [44] AFPSNet: Multi-Class Part Parsing based on Scaled Attention and Feature Fusion
    Alsudays, Njuod
    Wu, Jing
    Lai, Yu-Kun
    Ji, Ze
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 4022 - 4031
  • [45] Binary Image Steganographic Techniques Classification Based on Multi-class Steganalysis
    Chiew, Kang Leng
    Pieprzyk, Josef
    INFORMATION SECURITY PRACTICE AND EXPERIENCE, PROCEEDINGS, 2010, 6047 : 341 - +
  • [46] Attention-UNet architectures with pretrained backbones for multi-class cardiac MR image segmentation
    Das, Niharika
    Das, Sujoy
    CURRENT PROBLEMS IN CARDIOLOGY, 2024, 49 (01)
  • [47] Attention-based Fusion Network for Image Forgery Localization
    Gong, Wenhui
    Chen, Yan
    Alam, Mohammad S.
    Sang, Jun
    PATTERN RECOGNITION AND PREDICTION XXXV, 2024, 13040
  • [48] Image Annotation with Parametric Mixture Model Based Multi-class Multi-labeling
    Wang, Zhiyong
    Siu, Wan-Chi
    Feng, Dagan
    2008 IEEE 10TH WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING, VOLS 1 AND 2, 2008, : 635 - 638
  • [49] A Feature Selection Method based on the Sparse Multi-Class SVM for Fingerprinting Localization
    Li, Pan
    Meng, Huadong
    Wang, Xiqin
    2014 IEEE 80TH VEHICULAR TECHNOLOGY CONFERENCE (VTC FALL), 2014,
  • [50] Network Intrusion Detection Based on Multi-Class Support Vector Machine
    Anh Vu Le
    Hoai An Le Thi
    Manh Cuong Nguyen
    Zidna, Ahmed
    COMPUTATIONAL COLLECTIVE INTELLIGENCE - TECHNOLOGIES AND APPLICATIONS, PT I, 2012, 7653 : 536 - 543