DsP-YOLO: An anchor-free network with DsPAN for small object detection of multiscale defects

被引:70
|
作者
Zhang, Yan [1 ]
Zhang, Haifeng [1 ]
Huang, Qingqing [1 ]
Han, Yan [1 ]
Zhao, Minghang [2 ]
机构
[1] Chongqing Univ Posts & Telecommun, Minist Educ, Key Lab Ind Internet Things & Networked Control, Chongqing 400065, Peoples R China
[2] Harbin Inst Technol Weihai, Sch Ocean Engn, Weihai 264209, Shandong, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Industrial defect; YOLOv8; Small object detection; Feature enhancement; Feature fusion; Anchor -free network; ALGORITHM;
D O I
10.1016/j.eswa.2023.122669
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Industrial defect detection is of great significance to ensure the quality of industrial products. The surface defects of industrial products are characterized by multiple scales, multiple types, abundant small objects, and complex background interference. In particular, small object detection of multiscale defects under complex background interference poses significant challenges for defect detection tasks. How to improve the algorithm's ability to detect industrial defects, especially in enhancing the detection capabilities of small-sized defects, while ensuring that the inference speed is not overly affected is a long-term prominent challenge. Aiming at achieving accurate and fast detection of industrial defects, this paper proposes an anchor-free network with DsPAN for small object detection. The core of this method is to propose a new idea i.e., feature enhancement in the feature fusion network for the feature information of small-size objects. Firstly, anchor-free YOLOv8 is adopted as the basic framework for detection to eliminate the affections of hyperparameters related to anchors, as well as to improve the detection capability of multi-scale and small-size defects. Secondly, considering the PAN path (top layer of neural networks for feature fusion) is more task-specific, we advocate that the underlying feature map of the PAN path is more vulnerable to small object detection. Hence, we in-depth study the PAN path and point out that the standard PAN will encounter several drawbacks caused by losing local details and position information in deep layer. As an alternative, we propose a lightweight and detail-sensitive PAN (DsPAN) for small object detection of multiscale defects by designing an attention mechanism embedded feature transformation module(LCBHAM) and optimizing the lightweight implementation. Our proposed DsPAN is very easy to be incorporated in YOLO series framework. The proposed method is evaluated on three public datasets, NEU-DET, PCB-DET, and GC10-DET. The mAP of the method is 80.4%, 95.8%, and 76.3%, which are 3.6%, 2.1%, and 3.9% higher than that of YOLOv8 and significantly higher than the state-of-the-art (SOTA) detection methods. Also, the method achieves the second-highest inference speed among the thirteen models tested. The results indicate that DsP-YOLO is expected to be used for real-time defect detection in industry.
引用
收藏
页数:17
相关论文
共 50 条
  • [21] Coordinate-based anchor-free module for object detection
    Tang, Zhiyong
    Yang, Jianbing
    Pei, Zhongcai
    Song, Xiao
    APPLIED INTELLIGENCE, 2021, 51 (12) : 9066 - 9080
  • [22] An improved anchor-free method for traffic scene object detection
    Ding, Tonghe
    Feng, Kaili
    Yan, Yejin
    Wei, Yanjun
    Li, Tianping
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (22) : 34703 - 34724
  • [23] MFFPN: an Anchor-Free Method for Patent Drawing Object Detection
    Chen, Yu-Hsien
    Chiu, Chih-Yi
    2023 18TH INTERNATIONAL CONFERENCE ON MACHINE VISION AND APPLICATIONS, MVA, 2023,
  • [24] Domain Adaptation of Anchor-Free object detection for urban traffic
    Yu, Xiaoyong
    Lu, Xiaoqiang
    NEUROCOMPUTING, 2024, 582
  • [25] An improved anchor-free method for traffic scene object detection
    Tonghe Ding
    Kaili Feng
    Yejin Yan
    Yanjun Wei
    Tianping Li
    Multimedia Tools and Applications, 2023, 82 : 34703 - 34724
  • [26] Fabric defect detection based on anchor-free network
    Wang, Xianbao
    Fang, Weijie
    Xiang, Sheng
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2023, 34 (12)
  • [27] Anchor-free object detection in remote sensing images using a variable receptive field network
    Shenshen Fu
    Yifan He
    Xiaofeng Du
    Yi Zhu
    EURASIP Journal on Advances in Signal Processing, 2023
  • [28] Oriented Object Detection in Remote Sensing Images with Anchor-Free Oriented Region Proposal Network
    Li, Jianxiang
    Tian, Yan
    Xu, Yiping
    Zhang, Zili
    REMOTE SENSING, 2022, 14 (05)
  • [29] KRRNet: Keypoint Relational Regression Network for Bottom-Up Anchor-Free Object Detection
    Wang, Yinyuan
    Du, Haowen
    Cheng, Zhuo
    Gao, Changxin
    Wei, Longsheng
    Fang, Bin
    Xiao, Fei
    Luo, Dapeng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (04) : 2249 - 2260
  • [30] Anchor-free object detection in remote sensing images using a variable receptive field network
    Fu, Shenshen
    He, Yifan
    Du, Xiaofeng
    Zhu, Yi
    EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING, 2023, 2023 (01)