Bilateral guidance network for one-shot metal defect segmentation

被引:1
|
作者
Shan, Dexing [1 ]
Zhang, Yunzhou [1 ]
Liu, Xiaozheng [1 ]
Zhao, Jiaqi [1 ]
Coleman, Sonya [2 ]
Kerr, Dermot [2 ]
机构
[1] Northeastern Univ, Coll Informat Sci & Engn, Shenyang, Liaoning, Peoples R China
[2] Univ Ulster, Intelligent Syst Res Ctr, Londonderry, England
关键词
Neural network application; One-shot metal defect segmentation; Affinity learning; Bilateral guidance mechanism; Cross-attention;
D O I
10.1016/j.engappai.2023.107802
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Metal defect inspection is critical for maintaining product quality and ensuring production safety. However, the vast majority of existing defect segmentation methods rely heavily on large-scale datasets that only cater to specific defects, making them unsuitable for the industrial sector, where training samples are often limited. To address these challenges, we propose a bilateral guidance network for one-shot metal defect segmentation that leverages the perceptual consistency of background regions within industrial images to distinguish foreground and background regions. Our model uses an interactive feature reweighting scheme that models the inter- and self -dependence of foreground and background feature maps, enabling us to build robust pixel -level correspondences. Our proposed method demonstrates good domain adaptability and accurately segments defects in multiple materials, such as steel, leather, and carpet, among others. Additionally, we have incorporated a multi -scale receptive field encoder to enhance the model's ability to perceive objects of varying scales, providing a comprehensive solution for industrial defect segmentation. Experimental results indicate that our proposed method has the potential to be effective in a variety of real -world applications where defects may not be immediately visible or where large amounts of labeled data are not readily available. With only one shot, our method achieves the state-of-the-art performance of 41.62% mIoU and 70.30% MPA on the Defect-3' dataset.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] Self-supervised learning based transformer and convolution hybrid network for one-shot organ segmentation
    Wang, Bo
    Li, Qian
    You, Zheng
    NEUROCOMPUTING, 2023, 527 : 1 - 12
  • [42] A Foreground Prototype-Based One-Shot Segmentation of Brain Tumors
    Balasundaram, Ananthakrishnan
    Kavitha, Muthu Subash
    Pratheepan, Yogarajah
    Akshat, Dhamale
    Kaushik, Maddirala Venkata
    DIAGNOSTICS, 2023, 13 (07)
  • [43] Self-Supervised Interactive Embedding for One-Shot Organ Segmentation
    Yang, Yang
    Wang, Bo
    Zhang, Dingwen
    Yuan, Yixuan
    Yan, Qingsen
    Zhao, Shijie
    You, Zheng
    Han, Junwei
    IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2023, 70 (10) : 2799 - 2808
  • [44] Semantically Meaningful Class Prototype Learning for One-Shot Image Segmentation
    Chen, Tao
    Xie, Guo-Sen
    Yao, Yazhou
    Wang, Qiong
    Shen, Fumin
    Tang, Zhenmin
    Zhang, Jian
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 968 - 980
  • [45] Density-based one-shot active learning for image segmentation
    Jin, Qiuye
    Li, Shiman
    Du, Xiaofei
    Yuan, Mingzhi
    Wang, Manning
    Song, Zhijian
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 126
  • [46] One-Shot Traumatic Brain Segmentation with Adversarial Training and Uncertainty Rectification
    Zhao, Xiangyu
    Shen, Zhenrong
    Chen, Dongdong
    Wang, Sheng
    Zhuang, Zixu
    Wang, Qian
    Zhang, Lichi
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT IV, 2023, 14223 : 120 - 129
  • [47] ONE-SHOT SEGMENTATION OF BREAST, PECTORAL MUSCLE, AND BACKGROUND IN DIGITISED MAMMOGRAMS
    Oliver, Arnau
    Llado, Xavier
    Torrent, Albert
    Marti, Joan
    2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 912 - 916
  • [48] Unseen-Material Few-Shot Defect Segmentation With Optimal Bilateral Feature Transport Network
    Shan, Dexing
    Zhang, Yunzhou
    Coleman, Sonya
    Kerr, Dermot
    Liu, Shitong
    Hu, Ziqiang
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (07) : 8072 - 8082
  • [49] Environment Adaptive Deep Learning Classification System Based on One-shot Guidance
    Jin, Guanghao
    Pei, Chunmei
    Zhao, Na
    Li, Hengguang
    Song, Qingzeng
    Yu, Jing
    CMC-COMPUTERS MATERIALS & CONTINUA, 2022, 73 (03): : 5185 - 5196
  • [50] One amplifier makes one-shot
    Dijkstra, W
    EDN, 1999, 44 (07) : 102 - 102