A pixel-level deep segmentation network for automatic defect detection

被引:17
|
作者
Yang, Lei [2 ]
Xu, Shuai
Fan, Junfeng [3 ]
Li, En [3 ]
Liu, Yanhong [1 ,2 ]
机构
[1] Zhengzhou Univ, Sch Elect & Informat Engn, Zhengzhou 450001, Henan, Peoples R China
[2] Robot Percept & Control Engn Lab, Zhengzhou 450001, Henan, Peoples R China
[3] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst c, Beijing 100190, Peoples R China
基金
中国国家自然科学基金;
关键词
Defect detection; Deep convolutional neural network; U-shape network; ConvLSTM network; SURFACE-DEFECTS; INSPECTION; RECONSTRUCTION; SYSTEM;
D O I
10.1016/j.eswa.2022.119388
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Defect detection is a very important link for much manufacturing and processing applications which could be used for quality control and precise maintenance decision. However, faced with the weak-texture and low-contrast industrial environment, high-precision defect detection still faces a certain challenge due to diverse and complex of defects. Meanwhile, due to a minimal portion image pixels of defects, the pixel-level defect detection task is always against class-unbalance issue which also will affect the detection performance. Recently, with the strong automatic feature representation ability, deep learning has shown an excellent detection performance on defect identification and location. Nevertheless, it still has some demerits, such as insufficient processing of feature maps, lack of temporal modeling information, etc. To address these issues, on the basis of the encoder-decoder architecture, a pixel-level deep segmentation network is proposed for automatic defect detection to construct an end-to-end defect segmentation model. To realize effective feature representation, a residual attention network is proposed to construct the backbone network, which could also make the segmentation network better emphasize target regions. Meanwhile, to improve the network propagation ability of subtle context features, a bidirectional convolutional long short-term memory (ConvLSTM) block is introduced to optimize the skip connections to learn long-range spatial contexts. Besides, a weighted loss function is proposed for model training to address the class-unbalance issue. Combined with multiple public data sets, through qualitative and quantitative analysis, experimental results demonstrate that the proposed defect segmentation network achieves a better performance compared to other state-of-the-art segmentation methods.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] An integrated approach to automatic pixel-level crack detection and quantification of asphalt pavement
    Ji, Ankang
    Xue, Xiaolong
    Wang, Yuna
    Luo, Xiaowei
    Xue, Weirui
    AUTOMATION IN CONSTRUCTION, 2020, 114
  • [42] ARF-Crack: rotation invariant deep fully convolutional network for pixel-level crack detection
    Fu-Chen Chen
    Mohammad R. Jahanshahi
    Machine Vision and Applications, 2020, 31
  • [43] Combining pixel-level and patch-level information for segmentation
    Wang, Tao
    Ji, Zexuan
    Sun, Quansen
    Han, Shoudong
    NEUROCOMPUTING, 2015, 158 : 13 - 25
  • [44] Automatic pixel-level detection of tire defects based on a lightweight Transformer architecture
    Sun, Yingwei
    Liu, Xiyu
    Zhai, Xiaodi
    Sun, Kuizhi
    Zhao, Mengmeng
    Chang, Yankang
    Zhang, Yan
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2023, 34 (08)
  • [45] InceptionV3 based enriched feature integration network architecture for pixel-level surface defect detection
    Uzen, Huseyin
    Turkoglu, Muammer
    Ari, Ali
    Hanbay, Davut
    JOURNAL OF THE FACULTY OF ENGINEERING AND ARCHITECTURE OF GAZI UNIVERSITY, 2023, 38 (02): : 721 - 732
  • [46] Pixel-Level Bijective Matching for Video Object Segmentation
    Cho, Suhwan
    Lee, Heansung
    Kim, Minjung
    Jang, Sungjun
    Lee, Sangyoun
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 1453 - 1462
  • [47] Structured Deep Learning for Pixel-level Understanding
    Wei, Yunchao
    Liang, Xiaodan
    Liu, Si
    Lin, Liang
    PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, : 2090 - 2092
  • [48] An Effective Hybrid Atrous Convolutional Network for Pixel-Level Crack Detection
    Chen, Hanshen
    Lin, Huiping
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [49] Lightweight pixel-level semantic segmentation and analysis for sewer defects using deep learning
    Dang, L. Minh
    Wang, Hanxiang
    Li, Yanfen
    Nguyen, Le Quan
    Nguyen, Tan N.
    Song, Hyoung-Kyu
    Moon, Hyeonjoon
    CONSTRUCTION AND BUILDING MATERIALS, 2023, 371
  • [50] Automatic pixel-level detection method for concrete crack with channel-spatial attention convolution neural network
    Li, Yuanyuan
    Yu, Meng
    Wu, Decheng
    Li, Rui
    Xu, Kefei
    Cheng, Longqi
    STRUCTURAL HEALTH MONITORING-AN INTERNATIONAL JOURNAL, 2023, 22 (02): : 1460 - 1477