MSA-Net: Multi-scale attention network for image splicing localization

被引:1
|
作者
Yan, Caiping [1 ]
Wei, Huajian [1 ]
Lan, Zhi [1 ]
Li, Hong [2 ]
机构
[1] Hangzhou Normal Univ, Dept Comp Sci, Hangzhou 311121, Peoples R China
[2] Hangzhou InsVis Technol Co Ltd, Hangzhou 311121, Peoples R China
基金
中国国家自然科学基金;
关键词
Image forensics; Spatial-channel relationships; Multi-scale; Self-attention; Image splicing localization; FORGERY;
D O I
10.1007/s11042-023-16131-0
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we introduce the novel Multi-Scale Attention Network (MSA-Net) to address the challenge of locating diverse types and sizes of splicing forgery objects. Previous methods neglect crucial characteristics of global dependencies and size, resulting in imprecise localization on background tampering and small target tampering. To overcome this, we integrate a multi-scale self-attention mechanism to capture global dependencies and fully understand the relationships between spliced objects and untampered areas. Our approach involves inserting multi-scale attention modules that combine the position attention and channel attention modules between convolution layers for feature extraction. The position attention module emphasizes spatial interdependencies, capturing relationships between feature positions. Similarly, the channel attention module captures relationships between channel features. This allows for the preservation of intrinsic details while capturing long-range semantic dependencies, which is beneficial to the detection of splicing forgery objects. Meanwhile, by dividing the feature maps into multiple sub-regions or sub-channels, our attention modules can better preserve the details while capturing long-range semantic information dependencies. Experimental results show that the proposed MSA-Net outperforms several state-of-the-art algorithms with an F1-score of 60.5% and an IOU value of 58.8% on the CASIA dataset.
引用
收藏
页码:20587 / 20604
页数:18
相关论文
共 50 条
  • [31] Underwater Image Enhancement with Multi-Scale Residual Attention Network
    Ueki, Yosuke
    Ikehara, Masaaki
    2021 INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2021,
  • [32] Multi-scale network with attention mechanism for underwater image enhancement
    Tao, Ye
    Tang, Jinhui
    Zhao, Xinwei
    Zhou, Chen
    Wang, Chong
    Zhao, Zhonglei
    NEUROCOMPUTING, 2024, 595
  • [33] MC-Net: multi-scale context-attention network for medical CT image segmentation
    Haiying Xia
    Mingjun Ma
    Haisheng Li
    Shuxiang Song
    Applied Intelligence, 2022, 52 : 1508 - 1519
  • [34] MC-Net: multi-scale context-attention network for medical CT image segmentation
    Xia, Haiying
    Ma, Mingjun
    Li, Haisheng
    Song, Shuxiang
    APPLIED INTELLIGENCE, 2022, 52 (02) : 1508 - 1519
  • [35] MSSA-NET: MULTI-SCALE SELF-ATTENTION NETWORK FOR BREAST ULTRASOUND IMAGE SEGMENTATION
    Xu, Meng
    Huang, Kuan
    Chen, Qiuxiao
    Qi, Xiaojun
    2021 IEEE 18TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2021, : 827 - 831
  • [36] MSDRA-NET: A MULTI-SCALE ATTENTION-GUIDED NETWORK FOR MAGNETIC RESONANCE IMAGE RESTORATION
    You, Xuexiao
    Cao, Ning
    Wang, Wei
    JOURNAL OF MECHANICS IN MEDICINE AND BIOLOGY, 2024, 24 (02)
  • [37] Multi-scale attention context-aware network for detection and localization of image splicingEfficient and robust identification network
    Ruyong Ren
    Shaozhang Niu
    Junfeng Jin
    Jiwei Zhang
    Hua Ren
    Xiaojie Zhao
    Applied Intelligence, 2023, 53 : 18219 - 18238
  • [38] MLCTA-Net: multi-scale large convolution and triplet attention network for single image dehazing
    Tang, Qingshan
    Miao, Yongqi
    Huang, Xinwei
    Jiang, Huang
    SIGNAL IMAGE AND VIDEO PROCESSING, 2025, 19 (05)
  • [39] DCMA-Net: A dual channel multi-scale feature attention network for crack image segmentation
    Yan, Yidan
    Sun, Junding
    Zhang, Hongyuan
    Tang, Chaosheng
    Wu, Xiaosheng
    Wang, Shuihua
    Zhang, Yudong
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2025, 148
  • [40] Msap: multi-scale attention probabilistic network for underwater image enhancement network
    Chang, Baocai
    Li, Jinjiang
    Wang, Haiyang
    Li, Mengjun
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (SUPPL 1) : 653 - 661