Image tampering localization network based on multi-class attention and progressive subtraction

被引:0
|
作者
Shao, Yunxue [1 ]
Dai, Kun [1 ]
Wang, Lingfeng [2 ,3 ]
机构
[1] Nanjing Tech Univ, Coll Artif Intelligence, Nanjing 211816, Peoples R China
[2] Weiqiao UCAS Sci & Technol Pk, Binzhou Inst Technol, Binzhou 256606, Peoples R China
[3] Beijing Univ Chem Technol, Coll Informat Sci & Technol, Beijing 100029, Peoples R China
基金
中国国家自然科学基金;
关键词
Image tampering localization; EMER modules; Progressive subtraction; Shift operation;
D O I
10.1007/s11760-024-03622-2
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Image tamper localization is an important research topic in the field of computer vision, which aims at identifying and localizing human-modified regions in images. In this paper, we propose a new image tampering localization network, which is named MAPS-Net. It combines the advantages of efficient multi-scale attention, shift operation, and progressive subtraction, which not only improves the sensitivity and generalization to novel data tampering behaviors but also significantly reduces the computation time. MAPS-Net consists of upper and lower branches, which are the fake edge-enhancing branch and the interfering factors-weakening branch. The fake edge-enhancing branch uses an efficient multi-scale edge residual module to enhance the expressiveness of the features, while the interfering factors-weakening branch uses progressive subtraction to weaken the interference of image content fluctuations in capturing general tampering behaviors. Finally, the features of both branches are fused with a position attention mechanism via a shift operation to capture the spatial relationships between different views. Experiments conducted on several publicly available datasets show that MAPS-Net outperforms existing mainstream models in both image tampering detection and localization, especially in image tampering localization in real scenes. Code is available at: https://github.com/dklive1999/MAPS-Net.
引用
收藏
页数:10
相关论文
共 50 条
  • [31] Attention-Based Multi-Scale Convolutional Neural Network (A plus MCNN) for Multi-Class Classification in Road Images
    Eslami, Elham
    Yun, Hae-Bum
    SENSORS, 2021, 21 (15)
  • [32] Multi-Class Object Detection in Remote Sensing Image Based On Context information and Regularized Convolutional Network
    Cheng, Bei
    Li, Zhengzhou
    Wu, Qingqing
    SECOND TARGET RECOGNITION AND ARTIFICIAL INTELLIGENCE SUMMIT FORUM, 2020, 11427
  • [34] Multi-Class Active Learning for Image Classification
    Joshi, Ajay J.
    Porikli, Fatih
    Papanikolopoulos, Nikolaos
    CVPR: 2009 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOLS 1-4, 2009, : 2364 - +
  • [35] Feature subset selection for multi-class SVM based image classification
    Wang, Lei
    COMPUTER VISION - ACCV 2007, PT II, PROCEEDINGS, 2007, 4844 : 145 - 154
  • [36] A Bayesian multi-class image content retrieval
    Gomez, Ines
    Datcu, Mihai
    IGARSS: 2007 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, VOLS 1-12: SENSING AND UNDERSTANDING OUR PLANET, 2007, : 326 - +
  • [37] MQSearch: Image Search by Multi-Class Query
    Luo, Yiwen
    Liu, Wei
    Liu, Jianzhuang
    Tang, Xiaoou
    CHI 2008: 26TH ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS VOLS 1 AND 2, CONFERENCE PROCEEDINGS, 2008, : 49 - 52
  • [38] Multi-class discreviminant learning for image retrieval
    Tao, DC
    Tang, XO
    CISST '04: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON IMAGING SCIENCE, SYSTEMS, AND TECHNOLOGY, 2004, : 452 - 455
  • [39] Multi-class relevance feedback content-based image retrieval
    Peng, J
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2003, 90 (01) : 42 - 67
  • [40] Multi-class Image Classification Based on Fast Stochastic Gradient Boosting
    Li, Lin
    Wu, Yue
    Ye, Mao
    INFORMATICA-JOURNAL OF COMPUTING AND INFORMATICS, 2014, 38 (02): : 145 - 153