MSFYOLO: Feature fusion-based detection for small objects

被引:23
|
作者
Song, Ziying [1 ,2 ]
Zhang, Yu [2 ]
Liu, Yi [2 ]
Yang, Kuihe [2 ]
Sun, Meiling [2 ]
机构
[1] Hebei Normal Univ Sci & Technol, Qinhuangdao 066000, Hebei, Peoples R China
[2] Hebei Univ Sci & Technol, Sch Informat Sci & Engn, Shijiazhuang 050018, Hebei, Peoples R China
关键词
Feature extraction; Object detection; Semantics; Training; Mathematical models; Task analysis; Information science; Feature extraction network; Feature pyramid; Multi-scale feature fusion;
D O I
10.1109/TLA.2022.9693567
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
At present, the effect of object detection algorithm in small object detection is very poor, mainly because the low-level network lacks semantic information and the characteristic information expressed by small object inspection data is very lack. In view of the above difficulties, this paper proposes a small object detection algorithm based on multi-scale feature fusion. By learning shallow features at the shallow level and deep features at the deep level, the proposed multi-scale feature learning scheme focuses on the fusion of concrete features and abstract features. It constructs object detector (MSFYOLO) based on multi-scale deep feature learning network and considers the relationship between a single object and local environment. Combining global information with local information, the feature pyramid is constructed by fusing different depth feature layers in the network. In addition, this paper also proposes a new feature extraction network (CourNet), through the way of feature visualization compared with the mainstream backbone network, the network can better express the small object feature information. The proposed algorithm is valuated on the MS COCO and achieved leading performance with 11.7% improvement in FPS, 17.0% improvement in AP, 81.0% improvement in ARS, and 23.3% reduction in computational FPLOs compared to YOLOv3. This study shows that the combination of global information and local information is helpful to detect the expression of small objects in different illumination. MSFYOLO uses CourNet as the backbone network, which has high efficiency and a good balance between accuracy and speed.
引用
收藏
页码:823 / 830
页数:8
相关论文
共 50 条
  • [1] Detection of small objects based on feature fusion
    Zhang, Pan
    2022 PROGNOSTICS AND HEALTH MANAGEMENT CONFERENCE, PHM-LONDON 2022, 2022, : 384 - 388
  • [2] Feature Fusion-Based Data Augmentation Method for Small Object Detection
    Wang, Xin
    Zhang, Hongyan
    Liu, Qianhe
    Gong, Wei
    IEEE MULTIMEDIA, 2024, 31 (03) : 65 - 77
  • [3] nMultiscale Feature Fusion-Based Object Detection Algorithm
    Tao, Zhang
    Le, Zhang
    LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (02)
  • [4] Multi-feature fusion-based strabismus detection for children
    Zhang, Guiying
    Xu, Wenjing
    Gong, Haotian
    Sun, Lilei
    Li, Cong
    Chen, Huicong
    Xiang, Daoman
    IET IMAGE PROCESSING, 2023, 17 (05) : 1590 - 1602
  • [5] A Hierarchical Feature Fusion-based Method for Defect Recognition with a Small Sample
    Gao, Yiping
    Gao, Liang
    Li, Xinyu
    2019 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL ENGINEERING AND ENGINEERING MANAGEMENT (IEEM), 2019, : 1048 - 1052
  • [6] Adaptive Spatial Feature Fusion-Based SAR Ship Detection Algorithm
    Hong, Yue
    Min, Byung-Won
    Wang, Shentao
    Hu, Yuxiao
    2024 6TH INTERNATIONAL CONFERENCE ON DATA-DRIVEN OPTIMIZATION OF COMPLEX SYSTEMS, DOCS 2024, 2024, : 837 - 841
  • [7] Multi feature fusion-based water occlusion object detection algorithm
    Feng H.
    Jiang C.
    Xu H.
    Xie L.
    Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition), 2024, 52 (04): : 76 - 81
  • [8] A Semantic Fusion-Based Model for Infrared Small Target Detection
    Fan, Chunlong
    Zhang, Yuxue
    Jin, Qilong
    Xu, Li
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT VI, ICIC 2024, 2024, 14880 : 109 - 120
  • [9] Feature fusion-based multiple people tracking
    Lee, J
    Kim, S
    Kim, D
    Shin, J
    Paik, J
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2005, PT 1, 2005, 3767 : 843 - 853
  • [10] Feature fusion-based malicious code detection with dual attention mechanism and BiLSTM
    Shen, Gaoning
    Chen, Zhixiang
    Wang, Hui
    Chen, Heng
    Wang, Shuqi
    Computers and Security, 2022, 119