Multi-attention Integration Mechanism for Region Destruction Detection of Remote Sensing Images

被引:0
|
作者
Sun, Hang [1 ]
Sun, Yunyun [2 ]
Li, Peng [1 ,3 ]
Xu, He [1 ,3 ]
机构
[1] Nanjing Univ Posts & Telecommun, Sch Comp Sci, Nanjing 210023, Peoples R China
[2] Nanjing Univ Posts & Telecommun, Sch Internet Things, Nanjing 210023, Peoples R China
[3] Nanjing Univ Posts & Telecommun, Inst Cyberspace Secur & Informat Comp, Nanjing 130012, Peoples R China
关键词
Attention Mechanism; Remote Sensing Image; Destruction Detection; MA-CapsNet;
D O I
10.1007/978-3-031-50075-6_16
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the existing remote sensing image recognition, the problems of poor imaging quality, small sample size, and the difficulty of using a single attention mechanism to fully extract the hidden distinguishing features in the image, this paper proposes a method for detecting regional destruction in remote sensing images based on MA-CapsNet (multi-attention capsule encoder-decoder network) network. The method firstly adopts the BSRGAN model for image super-resolution processing of the original destruction data, and adopts various data enhancement operations for data expansion of the processed image, and then adopts the MA-CapsNet network proposed in this paper for further processing, using Swin-transformer and Convolutional Block The lower level features are extracted using a cascading attention mechanism consisting of Swin-transformer and Convolutional Block Attention Module (CBAM); finally, the feature map is fed into the classifier to complete the detection of the destroyed area after the precise target features are captured by the CapsNet module (CapsNet). In the destruction area detection experiment carried out in the remote sensing images after the 2010 Haiti earthquake, the accuracy of the MA-CapsNet model in area destruction detection reaches 99.64%, which is better than that of the current state-of-the-art models such as ResNet, Vision Transformer (VIT), and the ablation experimental network model. This method improves the model's characterization ability and solves the problem of low accuracy of remote sensing image destruction area detection under complex background, which is of theoretical guidance significance for quickly grasping remote sensing image destruction and damage assessment.
引用
收藏
页码:198 / 210
页数:13
相关论文
共 50 条
  • [21] A NOVEL MULTI-ATTENTION DRIVEN SYSTEM FOR MULTI-LABEL REMOTE SENSING IMAGE CLASSIFICATION
    Sumbul, Gencer
    Demir, Begum
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 5726 - 5729
  • [22] Multi-Attention Multi-Image Super-Resolution Transformer (MAST) for Remote Sensing
    Li, Jiaao
    Lv, Qunbo
    Zhang, Wenjian
    Zhu, Baoyu
    Zhang, Guiyu
    Tan, Zheng
    REMOTE SENSING, 2023, 15 (17)
  • [23] Gesture recognition based on sEMG using multi-attention mechanism for remote control
    Lv, Xiaodong
    Dai, Chuankai
    Liu, Haijie
    Tian, Ye
    Chen, Luyao
    Lang, Yiran
    Tang, Rongyu
    He, Jiping
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (19): : 13839 - 13849
  • [24] A Deep Multi-Attention Driven Approach for Multi-Label Remote Sensing Image Classification
    Sumbul, Gencer
    Demir, Begum
    IEEE ACCESS, 2020, 8 : 95934 - 95946
  • [25] Integrating attention mechanism and boundary detection for building segmentation from remote sensing images
    Liu, Ping
    Gao, Yu
    Zheng, Xiangtian
    Wang, Hesong
    Zhao, Yimeng
    Wu, Xinru
    Lu, Zehao
    Yue, Zhichuan
    Xie, Yuting
    Hao, Shufeng
    FRONTIERS IN NEUROROBOTICS, 2025, 18
  • [26] An Adaptive Attention Fusion Mechanism Convolutional Network for Object Detection in Remote Sensing Images
    Ye, Yuanxin
    Ren, Xiaoyue
    Zhu, Bai
    Tang, Tengfeng
    Tan, Xin
    Gui, Yang
    Yao, Qin
    REMOTE SENSING, 2022, 14 (03)
  • [27] Generating Anchor Boxes Based on Attention Mechanism for Object Detection in Remote Sensing Images
    Tian, Zhuangzhuang
    Zhan, Ronghui
    Hu, Jiemin
    Wang, Wei
    He, Zhiqiang
    Zhuang, Zhaowen
    REMOTE SENSING, 2020, 12 (15)
  • [28] Gesture recognition based on sEMG using multi-attention mechanism for remote control
    Xiaodong Lv
    Chuankai Dai
    Haijie Liu
    Ye Tian
    Luyao Chen
    Yiran Lang
    Rongyu Tang
    Jiping He
    Neural Computing and Applications, 2023, 35 : 13839 - 13849
  • [29] Remote Sensing Image Segmentation of Around Plateau Lakes Based on Multi-Attention Fusion
    He Z.-F.
    Shi B.-J.
    Zhang Y.-H.
    Li S.-M.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2023, 51 (04): : 885 - 895
  • [30] A Multi-Attention Fusion Mechanism for Collaborative Industrial Surface Defect Detection
    Yue, Xiaoli
    Zhong, Guoqiang
    Chu, Boce
    FOURTEENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING, ICGIP 2022, 2022, 12705