Research on efficient detection network method for remote sensing images based on self attention mechanism

被引:0
|
作者
Li, Jing [1 ,2 ,3 ,4 ,5 ]
Wei, Xiaomeng [2 ,3 ]
机构
[1] Henan Univ Sci & Technol, Informat Engn Coll, Luoyang 471023, Peoples R China
[2] Henan Mech & Elect Vocat Coll, Sch Informat Enginering, Xinzheng 451192, Peoples R China
[3] Henan Mech & Elect Vocat Coll, Sch Internet Things, Xinzheng 451192, Peoples R China
[4] Henan Univ Sci & Technol, Henan Int Joint Lab Cyberspace Secur Applicat, Luoyang 471023, Peoples R China
[5] Henan Univ Sci Technol, Coll Informat Enginering, Luoyang 471000, Peoples R China
基金
美国国家科学基金会;
关键词
Computer vision; Remote sensing images; Image detection; Faster R-CNN; Self attention mechanism; End-to-end;
D O I
10.1016/j.imavis.2023.104884
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Remote sensing images are widely used in aerial drones, satellites, and other fields. However, traditional object detection methods face challenges of low efficiency and accuracy due to the diverse scales, numerous target types, and complex backgrounds of remote sensing images. To address these issues, this paper proposes a remote sensing image detection network based on self-attention, which adaptively learns the relative importance of pixels to achieve more precise and efficient object detection in remote sensing images, meeting the demands of large-scale remote sensing image processing. Firstly, through end-to-end training, the object detection network is optimized as a whole to directly output detection results from the input remote sensing images, eliminating the need for additional intermediate steps. This not only reduces the impact of information loss and inconsistency but also simplifies the entire detection process. Secondly, we integrate the Faster R-CNN architecture as the foundation, combining region extraction and object classification into a unified process. Lastly, we embed selfattention mechanisms at different levels of the Faster R-CNN to progressively extract multi-scale and multilevel feature information, enhancing the network's ability to learn the correlation of information from different positions in the image, automatically capturing the relationships between objects, and improving the accuracy of object detection. This significantly reduces redundant computation, making it more efficient for large-scale remote sensing image processing. Experimental verification demonstrates that this approach outperforms traditional methods in terms of detection accuracy and efficiency, better addressing the particularities of remote sensing images, and providing an efficient and precise solution for aerial drone and satellite image processing. Remote sensing image detection has become one of the research hotspots in the field of remote sensing, holding significant theoretical significance and practical application value.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Change Detection of Remote Sensing Images Based on Attention Mechanism
    Chen, Long
    Zhang, Dezheng
    Li, Peng
    Lv, Peng
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2020, 2020
  • [2] Efficient method for detecting targets from remote sensing images based on global attention mechanism
    Gao, Zijun
    Su, Jingwen
    Li, Bo
    Wang, Jue
    Song, Zhankui
    IET IMAGE PROCESSING, 2025, 19 (01)
  • [3] Small Object Detection in Remote Sensing Images Based on Window Self-Attention Mechanism
    Xu, Jiaxin
    Zhang, Qiao
    Liu, Yu
    Zheng, Mengting
    PHOTOGRAMMETRIC ENGINEERING AND REMOTE SENSING, 2023, 89 (08): : 489 - 497
  • [4] An Adaptive Attention Fusion Mechanism Convolutional Network for Object Detection in Remote Sensing Images
    Ye, Yuanxin
    Ren, Xiaoyue
    Zhu, Bai
    Tang, Tengfeng
    Tan, Xin
    Gui, Yang
    Yao, Qin
    REMOTE SENSING, 2022, 14 (03)
  • [5] Anomaly Detection of Remote Sensing Images Based on the Channel Attention Mechanism and LRX
    Guo, Huinan
    Wang, Hua
    Song, Xiaodong
    Ruan, Zhongling
    APPLIED SCIENCES-BASEL, 2023, 13 (12):
  • [6] Remote sensing image road network detection based on channel attention mechanism
    Shan, Chuanhui
    Geng, Xinlong
    Chao, Han
    HELIYON, 2024, 10 (18)
  • [7] RoI Fusion Strategy With Self-Attention Mechanism for Object Detection in Remote Sensing Images
    Zhang, Yuxi
    Wang, Yongcheng
    Zhang, Ning
    Li, Zheng
    Zhao, Zhikang
    Gao, Yunxiao
    Chen, Chi
    Feng, Hao
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 5990 - 6006
  • [8] Fast Ship Detection in Remote Sensing Images Based on Multi-Attention Mechanism
    Huang, Jian
    Chen, Zhuo
    Xu, Hao
    Zhang, Xiushan
    5TH INTERNATIONAL CONFERENCE ON ALGORITHMS, COMPUTING AND SYSTEMS, ICACS 2021, 2021, : 105 - 112
  • [9] Generating Anchor Boxes Based on Attention Mechanism for Object Detection in Remote Sensing Images
    Tian, Zhuangzhuang
    Zhan, Ronghui
    Hu, Jiemin
    Wang, Wei
    He, Zhiqiang
    Zhuang, Zhaowen
    REMOTE SENSING, 2020, 12 (15)
  • [10] Efficient Object Detection Method Based on Improved YOLOv3 Network for Remote Sensing Images
    Wang, Jintao
    Xiao, Wen
    Ni, Tianwei
    2020 3RD INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND BIG DATA (ICAIBD 2020), 2020, : 242 - 246