MSA-Net: Multi-scale attention network for image splicing localization

被引:1
|
作者
Yan, Caiping [1 ]
Wei, Huajian [1 ]
Lan, Zhi [1 ]
Li, Hong [2 ]
机构
[1] Hangzhou Normal Univ, Dept Comp Sci, Hangzhou 311121, Peoples R China
[2] Hangzhou InsVis Technol Co Ltd, Hangzhou 311121, Peoples R China
基金
中国国家自然科学基金;
关键词
Image forensics; Spatial-channel relationships; Multi-scale; Self-attention; Image splicing localization; FORGERY;
D O I
10.1007/s11042-023-16131-0
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we introduce the novel Multi-Scale Attention Network (MSA-Net) to address the challenge of locating diverse types and sizes of splicing forgery objects. Previous methods neglect crucial characteristics of global dependencies and size, resulting in imprecise localization on background tampering and small target tampering. To overcome this, we integrate a multi-scale self-attention mechanism to capture global dependencies and fully understand the relationships between spliced objects and untampered areas. Our approach involves inserting multi-scale attention modules that combine the position attention and channel attention modules between convolution layers for feature extraction. The position attention module emphasizes spatial interdependencies, capturing relationships between feature positions. Similarly, the channel attention module captures relationships between channel features. This allows for the preservation of intrinsic details while capturing long-range semantic dependencies, which is beneficial to the detection of splicing forgery objects. Meanwhile, by dividing the feature maps into multiple sub-regions or sub-channels, our attention modules can better preserve the details while capturing long-range semantic information dependencies. Experimental results show that the proposed MSA-Net outperforms several state-of-the-art algorithms with an F1-score of 60.5% and an IOU value of 58.8% on the CASIA dataset.
引用
收藏
页码:20587 / 20604
页数:18
相关论文
共 50 条
  • [21] Gear Pitting Measurement by Multi-Scale Splicing Attention U-Net
    Qin, Yi
    Xi, Dejun
    Chen, Weiwei
    Wang, Yi
    CHINESE JOURNAL OF MECHANICAL ENGINEERING, 2023, 36 (01)
  • [22] MARes-Net: multi-scale attention residual network for jaw cyst image segmentation
    Ding, Xiaokang
    Jiang, Xiaoliang
    Zheng, Huixia
    Shi, Hualuo
    Wang, Ban
    Chan, Sixian
    FRONTIERS IN BIOENGINEERING AND BIOTECHNOLOGY, 2024, 12
  • [23] MCAD-Net: Multi-scale Coordinate Attention Dense Network for Single Image Deraining
    Li, Pengpeng
    Jin, Jiyu
    Jin, Guiyue
    Shi, Jiaqi
    Fan, Lei
    COMMUNICATIONS AND NETWORKING (CHINACOM 2021), 2022, : 405 - 421
  • [24] Multi-scale attention in attention neural network for single image deblurring☆
    Lee, Ho Sub
    Cho, Sung In
    DISPLAYS, 2024, 85
  • [25] MSA-MaxNet: Multi-Scale Attention Enhanced Multi-Axis Vision Transformer Network for Medical Image Segmentation
    Wu, Wei
    Huang, Junfeng
    Zhang, Mingxuan
    Li, Yichen
    Yu, Qijia
    Zhao, Qi
    JOURNAL OF CELLULAR AND MOLECULAR MEDICINE, 2024, 28 (24)
  • [26] MITD-Net: Multi-scale iterative tamper detection network for image manipulation localization
    Deng, Fan
    Yu, Haibo
    Liu, Tao
    Yang, Ruitao
    DIGITAL SIGNAL PROCESSING, 2025, 157
  • [27] Multi-scale attention network for image super-resolution
    Wang, Li
    Shen, Jie
    Tang, E.
    Zheng, Shengnan
    Xu, Lizhong
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2021, 80
  • [28] Multi-scale cascaded attention network for underwater image enhancement
    Zhao, Gaoli
    Wu, Yuheng
    Zhou, Ling
    Zhao, Wenyi
    Zhang, Weidong
    FRONTIERS IN MARINE SCIENCE, 2025, 12
  • [29] Multi-scale residual attention network for single image dehazing
    Sheng, Jiechao
    Lv, Guoqiang
    Du, Gang
    Wang, Zi
    Feng, Qibin
    DIGITAL SIGNAL PROCESSING, 2022, 121
  • [30] Multi-scale recurrent attention network for image motion deblurring
    Wang X.
    Ouyang W.
    Hongwai yu Jiguang Gongcheng/Infrared and Laser Engineering, 2022, 51 (06):