Research on efficient detection network method for remote sensing images based on self attention mechanism

被引:0
|
作者
Li, Jing [1 ,2 ,3 ,4 ,5 ]
Wei, Xiaomeng [2 ,3 ]
机构
[1] Henan Univ Sci & Technol, Informat Engn Coll, Luoyang 471023, Peoples R China
[2] Henan Mech & Elect Vocat Coll, Sch Informat Enginering, Xinzheng 451192, Peoples R China
[3] Henan Mech & Elect Vocat Coll, Sch Internet Things, Xinzheng 451192, Peoples R China
[4] Henan Univ Sci & Technol, Henan Int Joint Lab Cyberspace Secur Applicat, Luoyang 471023, Peoples R China
[5] Henan Univ Sci Technol, Coll Informat Enginering, Luoyang 471000, Peoples R China
基金
美国国家科学基金会;
关键词
Computer vision; Remote sensing images; Image detection; Faster R-CNN; Self attention mechanism; End-to-end;
D O I
10.1016/j.imavis.2023.104884
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Remote sensing images are widely used in aerial drones, satellites, and other fields. However, traditional object detection methods face challenges of low efficiency and accuracy due to the diverse scales, numerous target types, and complex backgrounds of remote sensing images. To address these issues, this paper proposes a remote sensing image detection network based on self-attention, which adaptively learns the relative importance of pixels to achieve more precise and efficient object detection in remote sensing images, meeting the demands of large-scale remote sensing image processing. Firstly, through end-to-end training, the object detection network is optimized as a whole to directly output detection results from the input remote sensing images, eliminating the need for additional intermediate steps. This not only reduces the impact of information loss and inconsistency but also simplifies the entire detection process. Secondly, we integrate the Faster R-CNN architecture as the foundation, combining region extraction and object classification into a unified process. Lastly, we embed selfattention mechanisms at different levels of the Faster R-CNN to progressively extract multi-scale and multilevel feature information, enhancing the network's ability to learn the correlation of information from different positions in the image, automatically capturing the relationships between objects, and improving the accuracy of object detection. This significantly reduces redundant computation, making it more efficient for large-scale remote sensing image processing. Experimental verification demonstrates that this approach outperforms traditional methods in terms of detection accuracy and efficiency, better addressing the particularities of remote sensing images, and providing an efficient and precise solution for aerial drone and satellite image processing. Remote sensing image detection has become one of the research hotspots in the field of remote sensing, holding significant theoretical significance and practical application value.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] LWCDnet: A Lightweight Network for Efficient Cloud Detection in Remote Sensing Images
    Luo, Chen
    Feng, Shanshan
    Yang, Xiaofei
    Ye, Yunming
    Li, Xutao
    Zhang, Baoquan
    Chen, Zhihao
    Quan, Yingling
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [32] Rotating Object Detection Method Based on Convolutional Block Channel Attention in Remote Sensing Images
    Wang, Huaiji
    Li, Guangming
    Zhang, Hongliang
    Shen, Jingao
    Wu, Jing
    Computer Engineering and Applications, 2024, 60 (02) : 200 - 210
  • [33] Attention Guided Network for Salient Object Detection in Optical Remote Sensing Images
    Lin, Yuhan
    Sun, Han
    Liu, Ningzhong
    Bian, Yetong
    Cen, Jun
    Zhou, Huiyu
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2022, PT I, 2022, 13529 : 25 - 36
  • [34] Aircraft detection in remote sensing images based on deconvolution and position attention
    Shi, Lukui
    Tang, Zhenjie
    Wang, Tiantian
    Xu, Xia
    Liu, Jing
    Zhang, Jun
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2021, 42 (11) : 4241 - 4260
  • [35] Aircraft Detection Method Based on Deep Convolutional Neural Network for Remote Sensing Images
    Guo Zhi
    Song Ping
    Zhang Yi
    Yan Menglong
    Sun Xian
    Sun Hao
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2018, 40 (11) : 2684 - 2690
  • [36] Semantic Segmentation With Attention Mechanism for Remote Sensing Images
    Zhao, Qi
    Liu, Jiahui
    Li, Yuewen
    Zhang, Hong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [37] A landslide extraction method of channel attention mechanism U-Net network based on Sentinel-2A remote sensing images
    Chen, Hesheng
    He, Yi
    Zhang, Lifeng
    Yao, Sheng
    Yang, Wang
    Fang, Yumin
    Liu, Yaoxiang
    Gao, Binghai
    INTERNATIONAL JOURNAL OF DIGITAL EARTH, 2023, 16 (01) : 552 - 577
  • [38] Integrating attention mechanism and boundary detection for building segmentation from remote sensing images
    Liu, Ping
    Gao, Yu
    Zheng, Xiangtian
    Wang, Hesong
    Zhao, Yimeng
    Wu, Xinru
    Lu, Zehao
    Yue, Zhichuan
    Xie, Yuting
    Hao, Shufeng
    FRONTIERS IN NEUROROBOTICS, 2025, 18
  • [39] Multi-attention Integration Mechanism for Region Destruction Detection of Remote Sensing Images
    Sun, Hang
    Sun, Yunyun
    Li, Peng
    Xu, He
    ADVANCES IN COMPUTER GRAPHICS, CGI 2023, PT III, 2024, 14497 : 198 - 210
  • [40] Research on Airplane and Ship Detection of Aerial Remote Sensing Images Based on Convolutional Neural Network
    Cao, Changqing
    Wu, Jin
    Zeng, Xiaodong
    Feng, Zhejun
    Wang, Ting
    Yan, Xu
    Wu, Zengyan
    Wu, Qifan
    Huang, Ziqiang
    SENSORS, 2020, 20 (17) : 1 - 16