A Pixel-Level Segmentation Convolutional Neural Network Based on Global and Local Feature Fusion for Surface Defect Detection

被引:8
|
作者
Zuo, Lei [1 ]
Xiao, Hongyong [1 ]
Wen, Long [1 ]
Gao, Liang [2 ]
机构
[1] China Univ Geosci, Sch Mech Engn & Elect Informat, Wuhan 430074, Peoples R China
[2] Huazhong Univ Sci & Technol, State Key Lab Digital Mfg Equipment & Technol, Wuhan 430074, Peoples R China
关键词
Convolutional neural networks; Surface cracks; Convolutional neural network; feature fusion; global mapping branch (GMB); pixel-level segmentation; surface defect detection (SDD);
D O I
10.1109/TIM.2023.3323004
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Surface defect detection (SDD) is a fundamental task in the smart industry to ensure product quality. Due to the complexity and diversity of the industrial scenes and the low contrast and tiny sizes of the defect, it is still difficult to accurately segment the defect. To overcome these issues, this research studied the pixel-level segmentation convolutional neural network based on multi-scale features, global mapping, feature pyramid and attention mechanisms (MMPA-Net). First, the low- and high-level features are extracted as the multiscale network to enrich the defect features information. Second, the global and local feature fusion (GLF) with the global mapping branch (GMB) module is developed to gradually refine the defect details to promote the detection of defects with different sizes and shapes. Third, deep supervision is applied to the global feature map and multiscale prediction maps to train MMPA-Net. MMPA-Net has been conducted on three public SDD datasets, and the results show that MMPA-Net has achieved state-of-the-art results on the intersection over union (IoU) by comparing with other deep learning (DL) methods (NEU-Seg: 86.62%, DAGM 2007: 87.94%, MT: 84.23%).
引用
收藏
页数:10
相关论文
共 50 条
  • [21] Automatic sewer defect detection and severity quantification based on pixel-level semantic segmentation
    Zhou, Qianqian
    Situ, Zuxiang
    Teng, Shuai
    Liu, Hanlin
    Chen, Weifeng
    Chen, Gongfa
    TUNNELLING AND UNDERGROUND SPACE TECHNOLOGY, 2022, 123
  • [22] APLCNet: Automatic Pixel-Level Crack Detection Network Based on Instance Segmentation
    Zhang, Yuefei
    Chen, Bin
    Wang, Jinfei
    Li, Jianming
    Sun, Xiaofei
    IEEE ACCESS, 2020, 8 : 199159 - 199170
  • [23] A Pixel-Level Segmentation Method for Water Surface Reflection Detection
    Wu, Qiwen
    Zheng, Xiang
    Wang, Jianhua
    Wang, Haozhu
    Che, Wenbo
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT II, 2024, 14426 : 493 - 505
  • [24] RUC-Net: A Residual-Unet-Based Convolutional Neural Network for Pixel-Level Pavement Crack Segmentation
    Yu, Gui
    Dong, Juming
    Wang, Yihang
    Zhou, Xinglin
    SENSORS, 2023, 23 (01)
  • [25] Pixel-Level Matching for Video Object Segmentation using Convolutional Neural Networks
    Yoon, Jae Shin
    Rameau, Francois
    Kim, Junsik
    Lee, Seokju
    Shin, Seunghak
    Kweon, In So
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 2186 - 2195
  • [26] A Surface Defect Detection Based on Convolutional Neural Network
    Wu, Xiaojun
    Cao, Kai
    Gu, Xiaodong
    COMPUTER VISION SYSTEMS, ICVS 2017, 2017, 10528 : 185 - 194
  • [27] A Global-Local Feature Multilevel Fusion Network for Chip Defect Segmentation
    Li, Fu
    Shi, Linfeng
    Li, Yan
    Zhu, Xi
    Chen, Juan
    Zhu, Linglong
    IEEE ACCESS, 2024, 12 : 17467 - 17480
  • [28] Automatic pixel-level bridge crack detection using learning context flux field with convolutional feature fusion
    Li, Gang
    Liu, Yiyang
    Shen, Dan
    Wang, Biao
    JOURNAL OF CIVIL STRUCTURAL HEALTH MONITORING, 2024, 14 (05) : 1155 - 1171
  • [29] An Effective Hybrid Atrous Convolutional Network for Pixel-Level Crack Detection
    Chen, Hanshen
    Lin, Huiping
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [30] PATCH-BASED FEATURE MAPS FOR PIXEL-LEVEL IMAGE SEGMENTATION
    Cao, Shuoying
    Iftikhar, Saadia
    Bharath, Anil Anthony
    2012 PROCEEDINGS OF THE 20TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2012, : 2263 - 2267