Image tampering localization network based on multi-class attention and progressive subtraction

被引:0
|
作者
Shao, Yunxue [1 ]
Dai, Kun [1 ]
Wang, Lingfeng [2 ,3 ]
机构
[1] Nanjing Tech Univ, Coll Artif Intelligence, Nanjing 211816, Peoples R China
[2] Weiqiao UCAS Sci & Technol Pk, Binzhou Inst Technol, Binzhou 256606, Peoples R China
[3] Beijing Univ Chem Technol, Coll Informat Sci & Technol, Beijing 100029, Peoples R China
基金
中国国家自然科学基金;
关键词
Image tampering localization; EMER modules; Progressive subtraction; Shift operation;
D O I
10.1007/s11760-024-03622-2
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Image tamper localization is an important research topic in the field of computer vision, which aims at identifying and localizing human-modified regions in images. In this paper, we propose a new image tampering localization network, which is named MAPS-Net. It combines the advantages of efficient multi-scale attention, shift operation, and progressive subtraction, which not only improves the sensitivity and generalization to novel data tampering behaviors but also significantly reduces the computation time. MAPS-Net consists of upper and lower branches, which are the fake edge-enhancing branch and the interfering factors-weakening branch. The fake edge-enhancing branch uses an efficient multi-scale edge residual module to enhance the expressiveness of the features, while the interfering factors-weakening branch uses progressive subtraction to weaken the interference of image content fluctuations in capturing general tampering behaviors. Finally, the features of both branches are fused with a position attention mechanism via a shift operation to capture the spatial relationships between different views. Experiments conducted on several publicly available datasets show that MAPS-Net outperforms existing mainstream models in both image tampering detection and localization, especially in image tampering localization in real scenes. Code is available at: https://github.com/dklive1999/MAPS-Net.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] Multi-class QoS routing strategies based on the network state
    Kochkar, H
    Ikenaga, T
    Kawahara, K
    Oie, Y
    COMPUTER COMMUNICATIONS, 2005, 28 (11) : 1348 - 1355
  • [22] On Evaluating Multi-class Network Traffic Classifiers Based on AUC
    Jie Yang
    Yi-Xuan Wang
    Yuan-Yuan Qiao
    Xiao-Xing Zhao
    Fang Liu
    Gang Cheng
    Wireless Personal Communications, 2015, 83 : 1731 - 1750
  • [23] ROUTING IN A NETWORK WITH MULTI-CLASS LINKS
    FANG, SC
    JOURNAL OF THE OPERATIONAL RESEARCH SOCIETY, 1984, 35 (07) : 637 - 640
  • [24] Multi-scale segmentation strategies in PRNU-based image tampering localization
    Zhang, Weiwei
    Tang, Xinhua
    Yang, Zhenghong
    Niu, Shaozhang
    MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (14) : 20113 - 20132
  • [25] Multi-scale segmentation strategies in PRNU-based image tampering localization
    Weiwei Zhang
    Xinhua Tang
    Zhenghong Yang
    Shaozhang Niu
    Multimedia Tools and Applications, 2019, 78 : 20113 - 20132
  • [26] On Evaluating Multi-class Network Traffic Classifiers Based on AUC
    Yang, Jie
    Wang, Yi-Xuan
    Qiao, Yuan-Yuan
    Zhao, Xiao-Xing
    Liu, Fang
    Cheng, Gang
    WIRELESS PERSONAL COMMUNICATIONS, 2015, 83 (03) : 1731 - 1750
  • [27] Superposition-enhanced quantum neural network for multi-class image classification
    Bai, Qi
    Hu, Xianliang
    CHINESE JOURNAL OF PHYSICS, 2024, 89 : 378 - 389
  • [28] A novel progressive learning technique for multi-class classification
    Venkatesan, Rajasekar
    Er, Meng Joo
    NEUROCOMPUTING, 2016, 207 : 310 - 321
  • [29] PLANET: Multi-Class Patch Layer Adaptive Network for Satellite Image Segmentation
    Islam, Md Samiul
    Cheng, Irene
    2024 IEEE SPACE, AEROSPACE AND DEFENCE CONFERENCE, SPACE 2024, 2024, : 588 - 591
  • [30] Knowledge-Based Fusion for Image Tampering Localization
    Iakovidou, Chryssanthi
    Papadopoulos, Symeon
    Kompatsiaris, Yiannis
    ARTIFICIAL INTELLIGENCE APPLICATIONS AND INNOVATIONS, AIAI 2020, PT I, 2020, 583 : 177 - 188