Image tampering localization network based on multi-class attention and progressive subtraction

被引:0
|
作者
Shao, Yunxue [1 ]
Dai, Kun [1 ]
Wang, Lingfeng [2 ,3 ]
机构
[1] Nanjing Tech Univ, Coll Artif Intelligence, Nanjing 211816, Peoples R China
[2] Weiqiao UCAS Sci & Technol Pk, Binzhou Inst Technol, Binzhou 256606, Peoples R China
[3] Beijing Univ Chem Technol, Coll Informat Sci & Technol, Beijing 100029, Peoples R China
基金
中国国家自然科学基金;
关键词
Image tampering localization; EMER modules; Progressive subtraction; Shift operation;
D O I
10.1007/s11760-024-03622-2
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Image tamper localization is an important research topic in the field of computer vision, which aims at identifying and localizing human-modified regions in images. In this paper, we propose a new image tampering localization network, which is named MAPS-Net. It combines the advantages of efficient multi-scale attention, shift operation, and progressive subtraction, which not only improves the sensitivity and generalization to novel data tampering behaviors but also significantly reduces the computation time. MAPS-Net consists of upper and lower branches, which are the fake edge-enhancing branch and the interfering factors-weakening branch. The fake edge-enhancing branch uses an efficient multi-scale edge residual module to enhance the expressiveness of the features, while the interfering factors-weakening branch uses progressive subtraction to weaken the interference of image content fluctuations in capturing general tampering behaviors. Finally, the features of both branches are fused with a position attention mechanism via a shift operation to capture the spatial relationships between different views. Experiments conducted on several publicly available datasets show that MAPS-Net outperforms existing mainstream models in both image tampering detection and localization, especially in image tampering localization in real scenes. Code is available at: https://github.com/dklive1999/MAPS-Net.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Image Tampering Localization Based on Integrated Multiscale Attention
    Wei, Huajian
    Yan, Caiping
    Li, Hong
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2024, 36 (08): : 1237 - 1245
  • [2] A general image tampering localization network based on progressive edge and mask co-guidance
    Bai, Ruyi
    SIGNAL IMAGE AND VIDEO PROCESSING, 2025, 19 (05)
  • [3] Mixed Attention Mechanism Generative Adversarial Network Painting Image Conversion Algorithm Based on Multi-Class Scenes
    Nie, Xinxin
    Pu, Jing
    IEEE ACCESS, 2023, 11 (123242-123252) : 123242 - 123252
  • [4] Localization in Wireless Sensor Network Based on Multi-class Support Vector Machines
    Liu, Hongbing
    Xiong, Shengwu
    Chen, Qiong
    2009 5TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS, NETWORKING AND MOBILE COMPUTING, VOLS 1-8, 2009, : 3322 - 3325
  • [5] Deep Decision Network for Multi-Class Image Classification
    Murthy, Venkatesh N.
    Singh, Vivek
    Chen, Terrence
    Manmatha, R.
    Comaniciu, Dorin
    2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 2240 - 2248
  • [6] Dual-stream network with complementary fusion and hierarchical attention for image tampering localization
    Mao, Zhanpeng
    Lu, Tongwei
    SIGNAL IMAGE AND VIDEO PROCESSING, 2025, 19 (03)
  • [7] Multi-Clue Image Tampering Localization
    Gaborini, Lorenzo
    Bestagini, Paolo
    Milani, Simone
    Tagliasacchi, Marco
    Tubaro, Stefano
    2014 IEEE INTERNATIONAL WORKSHOP ON INFORMATION FORENSICS AND SECURITY (WIFS'14), 2014, : 125 - 130
  • [8] Image Tampering Localization Based on Visual Multi-Scale Transformer
    Lu L.
    Zhong W.
    Wu X.
    Huanan Ligong Daxue Xuebao/Journal of South China University of Technology (Natural Science), 2022, 50 (06): : 10 - 18
  • [9] Multi-Attention Multi-Class Constraint for Fine-grained Image Recognition
    Sun, Ming
    Yuan, Yuchen
    Zhou, Feng
    Ding, Errui
    COMPUTER VISION - ECCV 2018, PT XVI, 2018, 11220 : 834 - 850
  • [10] Progressive Multi-scale Consistent Network for Multi-class Fundus Lesion Segmentation
    He, Along
    Wang, Kai
    Li, Tao
    Bo, Wang
    Kang, Hong
    Fu, Huazhu
    arXiv, 2022,