MFFSODNet: Multiscale Feature Fusion Small Object Detection Network for UAV Aerial Images

被引:16
|
作者
Jiang, Lingjie [1 ,2 ,3 ]
Yuan, Baoxi [1 ,2 ,3 ]
Du, Jiawei [1 ]
Chen, Boyu [4 ]
Xie, Hanfei [1 ,2 ,3 ]
Tian, Juan [5 ]
Yuan, Ziqi [6 ]
机构
[1] Xijing Univ, Sch Elect Informat, Xian 710123, Peoples R China
[2] Xijing Univ, Xian Key Lab High Precis Ind Intelligent Vis Measu, Xian 710123, Peoples R China
[3] Shaanxi Jiurui Technol Co Ltd, Xian 710065, Shaanxi, Peoples R China
[4] Air Force Engn Univ, Air Traff Control & Ground Control Intercept Coll, Xian 710038, Peoples R China
[5] Xijing Univ, Sch Humanities & Educ, Xian 710123, Peoples R China
[6] Minzu Univ China, Sch Econ, Beijing 100081, Peoples R China
关键词
Deep learning; feature pyramid network (FPN); multiscale feature extraction; small object detection; unmanned aerial vehicle (UAV) aerial image;
D O I
10.1109/TIM.2024.3381272
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Unmanned aerial vehicle (UAV) aerial image object detection is a valuable and challenging research field. Despite the breakthrough of deep learning-based object detection networks in natural scenes, UAV images often exhibit characteristics such as a high proportion of small objects, dense distribution, and significant variations in object scales, posing great challenges for accurate detection. To address these issues, we propose an innovative multiscale feature fusion small object detection network (MFFSODNet). First, concerning the high proportion of small objects in UAV images, an additional tiny object prediction head is introduced instead of the large object prediction head. This approach provides a good detection accuracy of small objects and significantly reduces the parameters. Second, to enhance the feature extraction capability of the network for fine-grained information from small objects, a multiscale feature extraction module (MSFEM) is designed, which could extract rich and valuable multiscale feature information through convolution operation of different scales on multiple branches. Third, to fuse the fine-grained information from shallow feature maps and the semantic information from deep feature maps, a new bidirectional dense feature pyramid network (BDFPN) is proposed. By expanding the feature pyramid network scale and introducing skip connections, BDFPN achieves efficient multiscale information fusion. Extensive experiments on the VisDrone and UAVDT benchmark datasets demonstrate that MFFSODNet outperforms the state-of-the-art object detection methods and further validate the effectiveness and generalization of MFFSODNet on photovoltaic array defect datasets (PVDs).
引用
收藏
页码:1 / 14
页数:14
相关论文
共 50 条
  • [31] Cross-Modal Oriented Object Detection of UAV Aerial Images Based on Image Feature
    Wang, Huiying
    Wang, Chunping
    Fu, Qiang
    Zhang, Dongdong
    Kou, Renke
    Yu, Ying
    Song, Jian
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 21
  • [32] Small object detection using deep feature learning and feature fusion network
    Tong, Kang
    Wu, Yiquan
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 132
  • [33] A Small Object Detection Network Based on Multiple Feature Enhancement and Feature Fusion
    Tan K.
    Ding S.
    Wu S.
    Tian K.
    Ren J.
    Scientific Programming, 2023, 2023
  • [34] MLFFNet: Multilevel Feature Fusion Network for Object Detection in Sonar Images
    Wang, Zhen
    Guo, Jianxin
    Zeng, Leya
    Zhang, Chuanlei
    Wang, Buhong
    IEEE Transactions on Geoscience and Remote Sensing, 2022, 60
  • [35] MLFFNet: Multilevel Feature Fusion Network for Object Detection in Sonar Images
    Wang, Zhen
    Guo, Jianxin
    Zeng, Leya
    Zhang, Chuanlei
    Wang, Buhong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [36] Multi-scale object detection in UAV images based on adaptive feature fusion
    Tan, Siqi
    Duan, Zhijian
    Pu, Longzhong
    PLOS ONE, 2024, 19 (03):
  • [37] Adaptively Attentional Feature Fusion Oriented to Multiscale Object Detection in Remote Sensing Images
    Zhao, Wenqing
    Kang, Yijin
    Chen, Hao
    Zhao, Zhenhuan
    Zhao, Zhenbing
    Zhai, Yongjie
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [38] AMFEF-DETR: An End-to-End Adaptive Multi-Scale Feature Extraction and Fusion Object Detection Network Based on UAV Aerial Images
    Wang, Sen
    Jiang, Huiping
    Yang, Jixiang
    Ma, Xuan
    Chen, Jiamin
    DRONES, 2024, 8 (10)
  • [39] An Insulator Defect Detection Model in Aerial Images Based on Multiscale Feature Pyramid Network
    Hao, Kun
    Chen, Guanke
    Zhao, Lu
    Li, Zhisheng
    Liu, Yonglei
    Wang, Chuanqi
    IEEE Transactions on Instrumentation and Measurement, 2022, 71
  • [40] An Insulator Defect Detection Model in Aerial Images Based on Multiscale Feature Pyramid Network
    Hao, Kun
    Chen, Guanke
    Zhao, Lu
    Li, Zhisheng
    Liu, Yonglei
    Wang, Chuanqi
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71