Self-supervised Visual Anomaly Detection with Image Patch Generation and Comparison Networks

被引:0
|
作者
Huang, Jianfeng [1 ,2 ]
Zhao, Kaikai [1 ,2 ]
Li, Chenyang [1 ,2 ]
Lin, Yimin [1 ,2 ]
Liu, Zhaoxiang [1 ,2 ]
Wang, Kai [1 ,2 ]
Lian, Shiguo [1 ,2 ]
机构
[1] China Unicom, AI Innovat Ctr, Beijing 100013, Peoples R China
[2] China Unicom, Unicom Digital Technol, Beijing 100013, Peoples R China
关键词
Industrial anomaly detection; Self-supervised anomaly detection; Vision transformer;
D O I
10.1007/978-981-97-5609-4_8
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Automatic industrial anomaly detection, especially visual anomaly detection, is still a challenging task. Taking the product of cloth for example, there are often various intrinsic textures or color patterns on cloth images which makes it difficult to distinguish anomaly and normality. To tackle this issue, we propose a novel self-supervised anomaly detection method consisting of three steps. Firstly, the Vision Transformer-based generation network is trained to learn the product image's texture and color patterns and generate an image patch from the other two adjacent patches. Then, the Siamese-based comparison network is designed to compare the generated patch with the original one to identify and localize the anomaly. Finally, the location of anomaly is refined by a bi-directional inference strategy. Experimental results on both the public dataset MVTec AD and our practical dataset demonstrate the superiority of our method over other state-of-the-art approaches.
引用
收藏
页码:96 / 113
页数:18
相关论文
共 50 条
  • [31] Confidence-Aware and Self-supervised Image Anomaly Localisation
    Mueller, Johanna P.
    Baugh, Matthew
    Tan, Jeremy
    Dombrowski, Mischa
    Kainz, Bernhard
    UNCERTAINTY FOR SAFE UTILIZATION OF MACHINE LEARNING IN MEDICAL IMAGING, UNSURE 2023, 2023, 14291 : 177 - 187
  • [32] Enhancing Anomaly Detection in Melanoma Diagnosis Through Self-Supervised Training and Lesion Comparison
    Collenne, Jules
    Iguernaissi, Rabah
    Dubuisson, Severine
    Merad, Djamal
    MACHINE LEARNING IN MEDICAL IMAGING, MLMI 2023, PT II, 2024, 14349 : 155 - 163
  • [33] SMD Anomaly Detection: A Self-Supervised Texture-Structure Anomaly Detection Framework
    Luo, Jiaxiang
    Lin, Junbin
    Yang, Zhiyu
    Liu, Haiming
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [34] Self-supervised GAN for Image Generation by Correlating Image Channels
    Qian, Sheng
    Cao, Wen-Ming
    Li, Rui
    Wu, Si
    Wong, Hau-San
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2018, PT II, 2018, 11165 : 78 - 88
  • [35] Explaining Self-Supervised Image Representations with Visual Probing
    Basaj, Dominika
    Oleszkiewicz, Witold
    Sieradzki, Igor
    Gorszczak, Michal
    Rychalska, Barbara
    Trzcinski, Tomasz
    Zielinski, Bartosz
    PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 592 - 598
  • [36] Self-supervised Anomaly Detection by Self-distillation and Negative Sampling
    Rafiee, Nima
    Gholamipoor, Rahil
    Adaloglou, Nikolas
    Jaxy, Simon
    Ramakers, Julius
    Kollmann, Markus
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2022, PT IV, 2022, 13532 : 459 - 470
  • [37] Channel randomisation: Self-supervised representation learning for reliable visual anomaly detection in speciality crops
    Choi, Taeyeong
    Would, Owen
    Salazar-Gomez, Adrian
    Liu, Xin
    Cielniak, Grzegorz
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2024, 226
  • [38] Generative and Contrastive Self-Supervised Learning for Graph Anomaly Detection
    Zheng, Yu
    Jin, Ming
    Liu, Yixin
    Chi, Lianhua
    Phan, Khoa T.
    Chen, Yi-Ping Phoebe
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (12) : 12220 - 12233
  • [39] Classification-Based Self-Supervised Learning for Anomaly Detection
    Li, Honghu
    Zhu, Yuesheng
    He, Ying
    THIRTEENTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2021), 2021, 11878
  • [40] A NOVEL CONTRASTIVE LEARNING FRAMEWORK FOR SELF-SUPERVISED ANOMALY DETECTION
    Li, Jingze
    Lian, Zhichao
    Li, Min
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 3366 - 3370