A Generic Automated Surface Defect Detection Based on a Bilinear Model

被引:39
|
作者
Zhou, Fei [1 ]
Liu, Guihua [1 ]
Xu, Feng [1 ]
Deng, Hao [1 ]
机构
[1] Southwest Univ Sci & Technol, Sch Informat Engn, Mianyang 621010, Sichuan, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2019年 / 9卷 / 15期
基金
中国国家自然科学基金;
关键词
automated surface inspection; D-VGG16; bilinear model; Grad-CAM; classification; localization;
D O I
10.3390/app9153159
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Aiming at the problems of complex texture, variable interference factors and large sample acquisition in surface defect detection, a generic method of automated surface defect detection based on a bilinear model was proposed. To realize the automatic classification and localization of surface defects, a new Double-Visual Geometry Group16 (D-VGG16) is firstly designed as feature functions of the bilinear model. The global and local features fully extracted from the bilinear model by D-VGG16 are output to the soft-max function to realize the automatic classification of surface defects. Then the heat map of the original image is obtained by applying Gradient-weighted Class Activation Mapping (Grad-CAM) to the output features of D-VGG16. Finally, the defects in the original input image can be located automatically after processing the heat map with a threshold segmentation method. The training process of the proposed method is characterized by a small sample, end-to-end, and is weakly-supervised. Furthermore, experiments are performed on two public and two industrial datasets, which have different defective features in texture, shape and color. The results show that the proposed method can simultaneously realize the classification and localization of defects with different defective features. The average precision of the proposed method is above 99% on the four datasets, and is higher than the known latest algorithms.
引用
收藏
页数:17
相关论文
共 50 条
  • [21] Transformer-based Encoder-Decoder Model for Surface Defect Detection
    Lu, Xiaofeng
    Fan, Wentao
    6TH INTERNATIONAL CONFERENCE ON INNOVATION IN ARTIFICIAL INTELLIGENCE, ICIAI2022, 2022, : 125 - 130
  • [22] A Steel Surface Defect Detection Model Based on YOLOv7-tiny
    Wang, Yayun
    Tao, Ye
    Cui, Wenhua
    Shen, Lijia
    IAENG International Journal of Computer Science, 2024, 51 (12) : 2074 - 2082
  • [23] SURFACE DEFECT DETECTION OF STEEL BASED ON IMPROVED YOLOv7 MODEL
    Teng, W. Z.
    Zhang, Y. J.
    Zhang, H. G.
    Gao, D. X.
    METALURGIJA, 2024, 63 (3-4): : 399 - 402
  • [24] Metal Surface Defect Detection Based on Few Defect Datasets
    Li, Ruoming
    2019 5TH INTERNATIONAL CONFERENCE ON GREEN POWER, MATERIALS AND MANUFACTURING TECHNOLOGY AND APPLICATIONS (GPMMTA 2019), 2019, 2185
  • [25] Automated Surface Defect Detection Using High-Density Data
    Wells, Lee J.
    Shafae, Mohammed S.
    Camelio, Jaime A.
    JOURNAL OF MANUFACTURING SCIENCE AND ENGINEERING-TRANSACTIONS OF THE ASME, 2016, 138 (07):
  • [26] An Effective Framework of Automated Visual Surface Defect Detection for Metal Parts
    Qiu, Kepeng
    Tian, Luo
    Wang, Peng
    IEEE SENSORS JOURNAL, 2021, 21 (18) : 20412 - 20420
  • [27] A Deep Learning-based Generic Solder Defect Detection System
    Ye, Shi-Qi
    Xue, Chen-Sheng
    Jian, Cheng-Yuan
    Chen, Yi-Zhen
    Gung, Jia-Jiun
    Lin, Chia-Yu
    2022 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS - TAIWAN, IEEE ICCE-TW 2022, 2022, : 99 - 100
  • [28] A Generic Framework for Defect Detection on Vessel Structures based on Image Saliency
    Bonnin-Pascual, Francisco
    Ortiz, Alberto
    2016 IEEE 21ST INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES AND FACTORY AUTOMATION (ETFA), 2016,
  • [29] Automated steel surface defect detection and classification using a new deep learning-based approach
    Demir, Kursat
    Ay, Mustafa
    Cavas, Mehmet
    Demir, Fatih
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (11): : 8389 - 8406
  • [30] Automated On-line Fast Detection for Surface Defect of Steel Strip Based on Multivariate Discriminant Function
    Liu Weiwei
    Yan Yunhui
    Li Jun
    Zhang Yao
    Sun Hongwei
    2008 INTERNATIONAL SYMPOSIUM ON INTELLIGENT INFORMATION TECHNOLOGY APPLICATION, VOL II, PROCEEDINGS, 2008, : 493 - 497