A pixel-level deep segmentation network for automatic defect detection

被引:17
|
作者
Yang, Lei [2 ]
Xu, Shuai
Fan, Junfeng [3 ]
Li, En [3 ]
Liu, Yanhong [1 ,2 ]
机构
[1] Zhengzhou Univ, Sch Elect & Informat Engn, Zhengzhou 450001, Henan, Peoples R China
[2] Robot Percept & Control Engn Lab, Zhengzhou 450001, Henan, Peoples R China
[3] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst c, Beijing 100190, Peoples R China
基金
中国国家自然科学基金;
关键词
Defect detection; Deep convolutional neural network; U-shape network; ConvLSTM network; SURFACE-DEFECTS; INSPECTION; RECONSTRUCTION; SYSTEM;
D O I
10.1016/j.eswa.2022.119388
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Defect detection is a very important link for much manufacturing and processing applications which could be used for quality control and precise maintenance decision. However, faced with the weak-texture and low-contrast industrial environment, high-precision defect detection still faces a certain challenge due to diverse and complex of defects. Meanwhile, due to a minimal portion image pixels of defects, the pixel-level defect detection task is always against class-unbalance issue which also will affect the detection performance. Recently, with the strong automatic feature representation ability, deep learning has shown an excellent detection performance on defect identification and location. Nevertheless, it still has some demerits, such as insufficient processing of feature maps, lack of temporal modeling information, etc. To address these issues, on the basis of the encoder-decoder architecture, a pixel-level deep segmentation network is proposed for automatic defect detection to construct an end-to-end defect segmentation model. To realize effective feature representation, a residual attention network is proposed to construct the backbone network, which could also make the segmentation network better emphasize target regions. Meanwhile, to improve the network propagation ability of subtle context features, a bidirectional convolutional long short-term memory (ConvLSTM) block is introduced to optimize the skip connections to learn long-range spatial contexts. Besides, a weighted loss function is proposed for model training to address the class-unbalance issue. Combined with multiple public data sets, through qualitative and quantitative analysis, experimental results demonstrate that the proposed defect segmentation network achieves a better performance compared to other state-of-the-art segmentation methods.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] Quantifying Invasive Melanoma Volume by Deep Learning Segmentation at the Pixel-Level
    Neumann, Neil
    Wang, Michael
    Mehta, Amal
    Shah, Aman
    Olson, Mara
    Fan, Wudi
    Weier, Anna
    Zakhor, Avideh
    McCalmont, Timothy
    LABORATORY INVESTIGATION, 2022, 102 (SUPPL 1) : 346 - 347
  • [22] Quantifying Invasive Melanoma Volume by Deep Learning Segmentation at the Pixel-Level
    Neumann, Neil
    Wang, Michael
    Mehta, Amal
    Shah, Aman
    Olson, Mara
    Fan, Wudi
    Weier, Anna
    Zakhor, Avideh
    McCalmont, Timothy
    MODERN PATHOLOGY, 2022, 35 (SUPPL 2) : 346 - 347
  • [23] Automatic pixel-level multiple damage detection of concrete structure using fully convolutional network
    Li, Shengyuan
    Zhao, Xuefeng
    Zhou, Guangyi
    COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2019, 34 (07) : 616 - 634
  • [24] A review of deep learning methods for pixel-level crack detection
    Hongxia Li
    Weixing Wang
    Mengfei Wang
    Limin Li
    Vivian Vimlund
    Journal of Traffic and Transportation Engineering(English Edition), 2022, 9 (06) : 945 - 968
  • [25] A review of deep learning methods for pixel-level crack detection
    Li, Hongxia
    Wang, Weixing
    Wang, Mengfei
    Li, Limin
    Vimlund, Vivian
    JOURNAL OF TRAFFIC AND TRANSPORTATION ENGINEERING-ENGLISH EDITION, 2022, 9 (06) : 945 - 968
  • [26] Pixel-level pavement crack segmentation with encoder-decoder network
    Tang, Youzhi
    Zhang, Allen A.
    Luo, Lei
    Wang, Guolong
    Yang, Enhui
    MEASUREMENT, 2021, 184
  • [27] A spatial-channel hierarchical deep learning network for pixel-level automated crack detection
    Pan, Yue
    Zhang, Gaowei
    Zhang, Limao
    AUTOMATION IN CONSTRUCTION, 2020, 119
  • [28] Automatic pixel-level crack segmentation in images using fully convolutional neural network based on residual blocks and pixel local weights
    Ali, Raza
    Chuah, Joon Huang
    Abu Talip, Mohamad Sofian
    Mokhtar, Norrima
    Shoaib, Muhammad Ali
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2021, 104
  • [29] Pixel-level automatic detection and quantification of running bands on rail surfaces
    Yue, Mingjing
    Yang, Xiancai
    Qian, Yao
    Wang, Ping
    Xu, Jingmang
    Zhang, Allen A.
    AUTOMATION IN CONSTRUCTION, 2024, 165
  • [30] A transformer-based deep learning method for automatic pixel-level crack detection and feature quantification
    Ji, Ankang
    Xue, Xiaolong
    Zhang, Limao
    Luo, Xiaowei
    Man, Qingpeng
    ENGINEERING CONSTRUCTION AND ARCHITECTURAL MANAGEMENT, 2023,