DsP-YOLO: An anchor-free network with DsPAN for small object detection of multiscale defects

被引:70
|
作者
Zhang, Yan [1 ]
Zhang, Haifeng [1 ]
Huang, Qingqing [1 ]
Han, Yan [1 ]
Zhao, Minghang [2 ]
机构
[1] Chongqing Univ Posts & Telecommun, Minist Educ, Key Lab Ind Internet Things & Networked Control, Chongqing 400065, Peoples R China
[2] Harbin Inst Technol Weihai, Sch Ocean Engn, Weihai 264209, Shandong, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Industrial defect; YOLOv8; Small object detection; Feature enhancement; Feature fusion; Anchor -free network; ALGORITHM;
D O I
10.1016/j.eswa.2023.122669
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Industrial defect detection is of great significance to ensure the quality of industrial products. The surface defects of industrial products are characterized by multiple scales, multiple types, abundant small objects, and complex background interference. In particular, small object detection of multiscale defects under complex background interference poses significant challenges for defect detection tasks. How to improve the algorithm's ability to detect industrial defects, especially in enhancing the detection capabilities of small-sized defects, while ensuring that the inference speed is not overly affected is a long-term prominent challenge. Aiming at achieving accurate and fast detection of industrial defects, this paper proposes an anchor-free network with DsPAN for small object detection. The core of this method is to propose a new idea i.e., feature enhancement in the feature fusion network for the feature information of small-size objects. Firstly, anchor-free YOLOv8 is adopted as the basic framework for detection to eliminate the affections of hyperparameters related to anchors, as well as to improve the detection capability of multi-scale and small-size defects. Secondly, considering the PAN path (top layer of neural networks for feature fusion) is more task-specific, we advocate that the underlying feature map of the PAN path is more vulnerable to small object detection. Hence, we in-depth study the PAN path and point out that the standard PAN will encounter several drawbacks caused by losing local details and position information in deep layer. As an alternative, we propose a lightweight and detail-sensitive PAN (DsPAN) for small object detection of multiscale defects by designing an attention mechanism embedded feature transformation module(LCBHAM) and optimizing the lightweight implementation. Our proposed DsPAN is very easy to be incorporated in YOLO series framework. The proposed method is evaluated on three public datasets, NEU-DET, PCB-DET, and GC10-DET. The mAP of the method is 80.4%, 95.8%, and 76.3%, which are 3.6%, 2.1%, and 3.9% higher than that of YOLOv8 and significantly higher than the state-of-the-art (SOTA) detection methods. Also, the method achieves the second-highest inference speed among the thirteen models tested. The results indicate that DsP-YOLO is expected to be used for real-time defect detection in industry.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] An Anchor-Free Lightweight Object Detection Network
    Wang, Weina
    Gou, Yunyan
    IEEE ACCESS, 2023, 11 : 110361 - 110374
  • [2] Multiscale Anchor-Free Region Proposal Network for Pedestrian Detection
    Cao, Zhiwei
    Yang, Huihua
    Xu, Weijin
    Zhao, Juan
    Li, Lingqiao
    Pan, Xipeng
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2021, 2021
  • [3] An Anchor-Free Network With Density Map and Attention Mechanism for Multiscale Object Detection in Aerial Images
    Guo, Yiyou
    Tong, Xiaohua
    Xu, Xiong
    Liu, Sicong
    Feng, Yongjiu
    Xie, Huan
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [4] GEOSPATIAL OBJECT DETECTION WITH SINGLE SHOT ANCHOR-FREE NETWORK
    Guo, Yiyou
    Ji, Jinsheng
    Lu, Xiankai
    Xie, Huan
    Tong, Xiaohua
    IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 280 - 283
  • [5] Anchor-free Proposal Generation Network for Efficient Object Detection
    Nguyen, Hoanh
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2023, 14 (04) : 327 - 335
  • [6] Feature Alignment in Anchor-Free Object Detection
    Gao, Feng
    Cai, Yeyun
    Deng, Fang
    Yu, Chengpu
    Chen, Jie
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (08) : 3799 - 3810
  • [7] Anchor-free object detection with mask attention
    Yang, He
    Fan, Beibei
    Guo, Lingling
    EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2020, 2020 (01)
  • [8] Anchor-free object detection with mask attention
    He Yang
    Beibei Fan
    Lingling Guo
    EURASIP Journal on Image and Video Processing, 2020
  • [9] Siamese anchor-free object tracking with multiscale spatial attentions
    Jianming Zhang
    Benben Huang
    Zi Ye
    Li-Dan Kuang
    Xin Ning
    Scientific Reports, 11
  • [10] Siamese anchor-free object tracking with multiscale spatial attentions
    Zhang, Jianming
    Huang, Benben
    Ye, Zi
    Kuang, Li-Dan
    Ning, Xin
    SCIENTIFIC REPORTS, 2021, 11 (01)