A pixel-level deep segmentation network for automatic defect detection

被引:17
|
作者
Yang, Lei [2 ]
Xu, Shuai
Fan, Junfeng [3 ]
Li, En [3 ]
Liu, Yanhong [1 ,2 ]
机构
[1] Zhengzhou Univ, Sch Elect & Informat Engn, Zhengzhou 450001, Henan, Peoples R China
[2] Robot Percept & Control Engn Lab, Zhengzhou 450001, Henan, Peoples R China
[3] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst c, Beijing 100190, Peoples R China
基金
中国国家自然科学基金;
关键词
Defect detection; Deep convolutional neural network; U-shape network; ConvLSTM network; SURFACE-DEFECTS; INSPECTION; RECONSTRUCTION; SYSTEM;
D O I
10.1016/j.eswa.2022.119388
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Defect detection is a very important link for much manufacturing and processing applications which could be used for quality control and precise maintenance decision. However, faced with the weak-texture and low-contrast industrial environment, high-precision defect detection still faces a certain challenge due to diverse and complex of defects. Meanwhile, due to a minimal portion image pixels of defects, the pixel-level defect detection task is always against class-unbalance issue which also will affect the detection performance. Recently, with the strong automatic feature representation ability, deep learning has shown an excellent detection performance on defect identification and location. Nevertheless, it still has some demerits, such as insufficient processing of feature maps, lack of temporal modeling information, etc. To address these issues, on the basis of the encoder-decoder architecture, a pixel-level deep segmentation network is proposed for automatic defect detection to construct an end-to-end defect segmentation model. To realize effective feature representation, a residual attention network is proposed to construct the backbone network, which could also make the segmentation network better emphasize target regions. Meanwhile, to improve the network propagation ability of subtle context features, a bidirectional convolutional long short-term memory (ConvLSTM) block is introduced to optimize the skip connections to learn long-range spatial contexts. Besides, a weighted loss function is proposed for model training to address the class-unbalance issue. Combined with multiple public data sets, through qualitative and quantitative analysis, experimental results demonstrate that the proposed defect segmentation network achieves a better performance compared to other state-of-the-art segmentation methods.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Deep Pixel-Level Matching via Attention for Video Co-Segmentation
    Li, Junliang
    Wong, Hon-Cheng
    He, Shengfeng
    Lo, Sio-Long
    Zhang, Guifang
    Wang, Wenxiao
    APPLIED SCIENCES-BASEL, 2020, 10 (06):
  • [32] PlAA: Pixel-level Adversarial Attack on Attention for Deep Neural Network
    Liu, Huailin
    Liu, Jing
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2022, PT I, 2022, 13529 : 611 - 623
  • [33] NAiVE BAYES PIXEL-LEVEL PLANT SEGMENTATION
    Abbasi, Arash
    Fahlgren, Noah
    2016 IEEE WESTERN NEW YORK IMAGE AND SIGNAL PROCESSING WORKSHOP (WNYISPW), 2016,
  • [34] A novel real-time pixel-level road crack segmentation network
    Wang, Rongdi
    Wang, Hao
    He, Zhenhao
    Zhu, Jianchao
    Zuo, Haiqiang
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2024, 21 (03)
  • [35] Deep Network with Pixel-Level Rectification and Robust Training for Handwriting Recognition
    Xiao S.
    Peng L.
    Yan R.
    Wang S.
    SN Computer Science, 2020, 1 (3)
  • [36] Pixel-Level Crack Detection and Quantification of Nuclear Containment with Deep Learning
    Yu, Jian
    Xu, Yaming
    Xing, Cheng
    Zhou, Jianguo
    Pan, Pai
    STRUCTURAL CONTROL & HEALTH MONITORING, 2023, 2023
  • [37] Efficient Road Crack Detection Based on an Adaptive Pixel-Level Segmentation Algorithm
    Safaei, Nima
    Smadi, Omar
    Safaei, Babak
    Masoud, Arezoo
    TRANSPORTATION RESEARCH RECORD, 2021, 2675 (09) : 370 - 381
  • [38] ASFormer: attentive semantic feature fusion transformer for pixel-level defect detection
    Zhu, Qinmiao
    Hu, Huan
    Liu, Teng
    Yang, Hua
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2025, 36 (02)
  • [39] Automatic Pixel-Level Crack Detection for Civil Infrastructure Using Unet plus plus and Deep Transfer Learning
    Yang, Qiaoning
    Ji, Xiaodong
    IEEE SENSORS JOURNAL, 2021, 21 (17) : 19165 - 19175
  • [40] ARF-Crack: rotation invariant deep fully convolutional network for pixel-level crack detection
    Chen, Fu-Chen
    Jahanshahi, Mohammad R.
    MACHINE VISION AND APPLICATIONS, 2020, 31 (06)