A Pixel-Level Segmentation Convolutional Neural Network Based on Global and Local Feature Fusion for Surface Defect Detection

被引:8
|
作者
Zuo, Lei [1 ]
Xiao, Hongyong [1 ]
Wen, Long [1 ]
Gao, Liang [2 ]
机构
[1] China Univ Geosci, Sch Mech Engn & Elect Informat, Wuhan 430074, Peoples R China
[2] Huazhong Univ Sci & Technol, State Key Lab Digital Mfg Equipment & Technol, Wuhan 430074, Peoples R China
关键词
Convolutional neural networks; Surface cracks; Convolutional neural network; feature fusion; global mapping branch (GMB); pixel-level segmentation; surface defect detection (SDD);
D O I
10.1109/TIM.2023.3323004
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Surface defect detection (SDD) is a fundamental task in the smart industry to ensure product quality. Due to the complexity and diversity of the industrial scenes and the low contrast and tiny sizes of the defect, it is still difficult to accurately segment the defect. To overcome these issues, this research studied the pixel-level segmentation convolutional neural network based on multi-scale features, global mapping, feature pyramid and attention mechanisms (MMPA-Net). First, the low- and high-level features are extracted as the multiscale network to enrich the defect features information. Second, the global and local feature fusion (GLF) with the global mapping branch (GMB) module is developed to gradually refine the defect details to promote the detection of defects with different sizes and shapes. Third, deep supervision is applied to the global feature map and multiscale prediction maps to train MMPA-Net. MMPA-Net has been conducted on three public SDD datasets, and the results show that MMPA-Net has achieved state-of-the-art results on the intersection over union (IoU) by comparing with other deep learning (DL) methods (NEU-Seg: 86.62%, DAGM 2007: 87.94%, MT: 84.23%).
引用
收藏
页数:10
相关论文
共 50 条
  • [41] Visual inspection of aircraft skin: Automated pixel-level defect detection by instance segmentation
    Ding, Meng
    Wu, Boer
    Xu, Juan
    Kasule, Abdul Nasser
    Zuo, Hongfu
    CHINESE JOURNAL OF AERONAUTICS, 2022, 35 (10) : 254 - 264
  • [42] Visual inspection of aircraft skin: Automated pixel-level defect detection by instance segmentation
    Meng DING
    Boer WU
    Juan XU
    Abdul Nasser KASULE
    Hongfu ZUO
    Chinese Journal of Aeronautics, 2022, 35 (10) : 254 - 264
  • [43] A Multitask Fusion Network for Region-Level and Pixel-Level Pavement Distress Detection
    Zhong, Jingtao
    Zhang, Miaomiao
    Ma, Yuetan
    Xiao, Rui
    Cheng, Guantao
    Huang, Baoshan
    JOURNAL OF TRANSPORTATION ENGINEERING PART B-PAVEMENTS, 2024, 150 (01)
  • [44] CrackF-Net: a pixel-level segmentation network for pavement crack detection
    Luan, Shen
    Gao, Xingen
    Wang, Chen
    Zhang, Hongyi
    Chao, Fei
    Lin, Juqiang
    Huang, Junqi
    Jiang, Huali
    Lin, Feng
    JOURNAL OF ELECTRONIC IMAGING, 2023, 32 (06)
  • [45] Facial Expression Recognition Based on Local Feature Fusion of Convolutional Neural Network
    Yao Lisha
    Xu Guoming
    Zhao Feng
    LASER & OPTOELECTRONICS PROGRESS, 2020, 57 (04)
  • [46] A feature-based metric for the quantitative evaluation of pixel-level image fusion
    Liu, Zheng
    Forsyth, David S.
    Laganiere, Robert
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2008, 109 (01) : 56 - 68
  • [47] Robust Pixel-Level Crack Detection Using Deep Fully Convolutional Neural Networks
    Alipour, Mohamad
    Harris, Devin K.
    Miller, Gregory R.
    JOURNAL OF COMPUTING IN CIVIL ENGINEERING, 2019, 33 (06)
  • [48] SSGL-PIXEL LEVEL SAR SHIP INSTANCE SEGMENTATION NETWORK BASED ON GLOBAL AND LOCAL FEATURE CROSS ATTENTION
    Chang, Shibo
    Chang, Hao
    Zhang, Chunyan
    Fu, Xiongjun
    Ma, Zhifeng
    2024 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2024), 2024, : 9509 - 9512
  • [49] Bearing surface defect detection based on improved convolutional neural network
    Fu, Xian
    Yang, Xiao
    Zhang, Ningning
    Zhang, RuoGu
    Zhang, Zhuzhu
    Jin, Aoqun
    Ye, Ruiwen
    Zhang, Huiling
    MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2023, 20 (07) : 12341 - 12359
  • [50] A Weakly Supervised Surface Defect Detection Based on Convolutional Neural Network
    Xu, Liang
    Lv, Shuai
    Deng, Yong
    Li, Xiuxi
    IEEE ACCESS, 2020, 8 : 42285 - 42296