RDAD: A reconstructive and discriminative anomaly detection model based on transformer

被引:8
|
作者
Xie, Xin [1 ]
Huang, Yuhui [1 ]
Ning, Weiye [1 ]
Wu, Dengquan [1 ]
Li, Zixi [1 ]
Yang, Hao [2 ]
机构
[1] East China Jiaotong Univ, Sch Informat Engn, Nanchang 330013, Jiangxi, Peoples R China
[2] State Grid Jiangxi Elect Power Co Ltd, Elect Power Res Inst, Nanchang, Jiangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
channel transformer; squeeze-and-excitation blocks; surface anomaly detection;
D O I
10.1002/int.22974
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Given the shortcomings of low detection accuracy and poor generalization performance of most current surface defect detection methods for industrial products, this paper proposes a reconstructive and discriminative anomaly detection model. The proposed method uses squeeze-and-excitation block to assign the attention of feature channels to enhance the sensitivity of related features and improve the ability of the model to learn normal and anomaly boundaries. In addition, channel transformer is introduced in the encoder-decoder, so that the decoder better fuses the features in the encoder and reduces the semantic gap, and enhances the segmentation ability of anomalous regions of the model. The model is only trained with normal samples, and completes the localization of anomalous regions while detecting anomalies. Experiments are conducted on the challenging MVTec anomaly detection and Magnetic Tile Defect data sets. Compared with the current state-of-the-art unsupervised anomaly detection methods, the model not only improves the accuracy of anomaly detection, but also has better generality.
引用
收藏
页码:8928 / 8946
页数:19
相关论文
共 50 条
  • [1] Dual-Attention Transformer and Discriminative Flow for Industrial Visual Anomaly Detection
    Yao, Haiming
    Luo, Wei
    Yu, Wenyong
    Zhang, Xiaotian
    Qiang, Zhenfeng
    Luo, Donghao
    Shi, Hui
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2024, 21 (04) : 6126 - 6140
  • [2] Anomaly Transformer Ensemble Model for Cloud Data Anomaly Detection
    Sakong, Won
    Kwon, Jongyeop
    Min, Kyungha
    Wang, Suyeon
    Kim, Wooju
    IEEE TRANSACTIONS ON CLOUD COMPUTING, 2024, 12 (04) : 1305 - 1313
  • [3] Anomaly detection model for multivariate time series based on stochastic Transformer
    Huo W.
    Liang R.
    Li Y.
    Tongxin Xuebao/Journal on Communications, 2023, 44 (02): : 94 - 103
  • [4] A Discriminative Metric Learning Based Anomaly Detection Method
    Du, Bo
    Zhang, Liangpei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2014, 52 (11): : 6844 - 6857
  • [5] Anomaly Detection Based on Discriminative Generative Adversarial Network
    Appiah, Benjamin
    Qin, Zhiguang
    Nartey, Obed Tettey
    Agemang, Brighter
    Kanpogninge, Ansuura JohnBosco Aristotle
    International Journal of Network Security, 2021, 23 (04) : 718 - 724
  • [6] A Transformer-Based GAN for Anomaly Detection
    Yang, Caiyin
    Lan, Shiyong
    Huangl, Weikang
    Wang, Wenwu
    Liul, Guoliang
    Yang, Hongyu
    Ma, Wei
    Li, Piaoyang
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2022, PT II, 2022, 13530 : 345 - 357
  • [7] FrHPI: A Discriminative Patch -Image Model for Hyperspectral Anomaly Detection
    Li, Hao
    Fan, Ganghui
    Zeng, Shan
    Kang, Zhen
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2021, 2021
  • [8] A Discriminative DeepLab Model (DDLM) for Surface Anomaly Detection and Localization
    Gyimah, Nana Kankam
    Gupta, Kishor Datta
    Nabil, Mahmoud
    Yan, Xuyang
    Girma, Abenezer
    Homaifar, Abdollah
    Opoku, Daniel
    2023 IEEE 13TH ANNUAL COMPUTING AND COMMUNICATION WORKSHOP AND CONFERENCE, CCWC, 2023, : 1137 - 1144
  • [9] Anomaly detection in smart manufacturing: An Adaptive Adversarial Transformer-based model
    Orabi, Moussab
    Tran, Kim Phuc
    Egger, Philipp
    Thomassey, Sebastien
    JOURNAL OF MANUFACTURING SYSTEMS, 2024, 77 : 591 - 611
  • [10] Transformer Based Sptial-Temporal Extraction Model for Video Anomaly Detection
    Wang, Zhiqiang
    Gu, Xiaojing
    Gu, Xingsheng
    2024 8TH INTERNATIONAL CONFERENCE ON ROBOTICS, CONTROL AND AUTOMATION, ICRCA 2024, 2024, : 370 - 374