Small Object Detection in UAV Remote Sensing Images Based on Intra-Group Multi-Scale Fusion Attention and Adaptive Weighted Feature Fusion Mechanism

被引:1
|
作者
Yuan, Zhe [1 ]
Gong, Jianglei [1 ]
Guo, Baolong [1 ]
Wang, Chao [1 ]
Liao, Nannan [1 ]
Song, Jiawei [1 ]
Wu, Qiming [1 ]
机构
[1] Xidian Univ, Inst Intelligent Control & Image Engn, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
UAV remote sensing images; small object detection; feature fusion; attention mechanism; adaptive; TARGET DETECTION; OPTIMIZATION;
D O I
10.3390/rs16224265
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
In view of the issues of missed and false detections encountered in small object detection for UAV remote sensing images, and the inadequacy of existing algorithms in terms of complexity and generalization ability, we propose a small object detection model named IA-YOLOv8 in this paper. This model integrates the intra-group multi-scale fusion attention mechanism and the adaptive weighted feature fusion approach. In the feature extraction phase, the model employs a hybrid pooling strategy that combines Avg and Max pooling to replace the single Max pooling operation used in the original SPPF framework. Such modifications enhance the model's ability to capture the minute features of small objects. In addition, an adaptive feature fusion module is introduced, which is capable of automatically adjusting the weights based on the significance and contribution of features at different scales to improve the detection sensitivity for small objects. Simultaneously, a lightweight intra-group multi-scale fusion attention module is implemented, which aims to effectively mitigate background interference and enhance the saliency of small objects. Experimental results indicate that the proposed IA-YOLOv8 model has a parameter quantity of 10.9 MB, attaining an average precision (mAP) value of 42.1% on the Visdrone2019 test set, an mAP value of 82.3% on the DIOR test set, and an mAP value of 39.8% on the AI-TOD test set. All these results outperform the existing detection algorithms, demonstrating the superior performance of the IA-YOLOv8 model in the task of small object detection for UAV remote sensing.
引用
收藏
页数:26
相关论文
共 50 条
  • [1] Small object detection in remote sensing images based on attention mechanism and multi-scale feature fusion
    Zhang, Li-guo
    Wang, Lei
    Jin, Mei
    Geng, Xing-shuo
    Shen, Qian
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2022, 43 (09) : 3280 - 3297
  • [2] Remote Sensing Small Object Detection Network Based on Attention Mechanism and Multi-Scale Feature Fusion
    Qu, Junsuo
    Tang, Zongbing
    Zhang, Le
    Zhang, Yanghai
    Zhang, Zhenguo
    REMOTE SENSING, 2023, 15 (11)
  • [3] Multi-scale object detection in UAV images based on adaptive feature fusion
    Tan, Siqi
    Duan, Zhijian
    Pu, Longzhong
    PLOS ONE, 2024, 19 (03):
  • [4] Object Detection of Remote Sensing Image Based on Multi-Scale Feature Fusion and Attention Mechanism
    Du, Zuoqiang
    Liang, Yuan
    IEEE ACCESS, 2024, 12 : 8619 - 8632
  • [5] Object Detection in Remote Sensing Images Based on Adaptive Multi-Scale Feature Fusion Method
    Liu, Chun
    Zhang, Sixuan
    Hu, Mengjie
    Song, Qing
    REMOTE SENSING, 2024, 16 (05)
  • [6] Remote Sensing Object Detection Method Based on Attention Mechanism and Multi-scale Feature Fusion
    Liu, Yang
    Xiao, Yewei
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 7155 - 7160
  • [7] A Multi-Feature Fusion and Attention Network for Multi-Scale Object Detection in Remote Sensing Images
    Cheng, Yong
    Wang, Wei
    Zhang, Wenjie
    Yang, Ling
    Wang, Jun
    Ni, Huan
    Guan, Tingzhao
    He, Jiaxin
    Gu, Yakang
    Tran, Ngoc Nguyen
    REMOTE SENSING, 2023, 15 (08)
  • [8] Multi-Scale Feature Fusion Based Adaptive Object Detection for UAV
    Liu Fang
    Wu Zhiwei
    Yang Anzhe
    Han Xiao
    ACTA OPTICA SINICA, 2020, 40 (10)
  • [9] Residual attention mechanism and weighted feature fusion for multi-scale object detection
    Zhang, Jie
    Qi, Qiye
    Zhang, Huanlong
    Du, Qifan
    Wang, Fengxian
    Shi, Xiaoping
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (26) : 40873 - 40889
  • [10] Residual attention mechanism and weighted feature fusion for multi-scale object detection
    Jie Zhang
    Qiye Qi
    Huanlong Zhang
    Qifan Du
    Fengxian Wang
    Xiaoping Shi
    Multimedia Tools and Applications, 2023, 82 : 40873 - 40889