Local-global normality learning and discrepancy normalizing flow for unsupervised image anomaly detection

被引:0
|
作者
Yao, Haiming [1 ]
Luo, Wei [1 ]
Zhang, Weihang [2 ]
Zhang, Xiaotian [1 ]
Qiang, Zhenfeng [1 ]
Luo, Donghao [1 ]
机构
[1] Tsinghua Univ, State Key Lab Precis Measurement Technol & Instrum, Beijing 100084, Peoples R China
[2] Beijing Inst Technol, Sch Med Technol, Beijing 100081, Peoples R China
关键词
Unsupervised anomaly detection; Global-local semantics learning; Dual-branch vision transformer; Discrepancy normalizing flow;
D O I
10.1016/j.engappai.2024.109235
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The unsupervised detection and localization of image anomalies hold significant importance across various domains, particularly in industrial quality inspection. Despite its widespread utilization, this task remains inherently challenging due to its reliance solely on defect-free normal knowledge. This paper presents the local- global normality learning and discrepancy normalizing flow, a new state-of-the-art model for unsupervised image anomaly detection and localization. In contrast to existing methods, It adopts a two-stream approach that considers both local and global semantics, ensuring stable detection of abnormalities. The framework comprises two key components: the dual-branch Transformer and the discrepancy normalizing flow, facilitating reconstruction and discrimination. The proposed framework leverages pre-trained convolutional neural networks to extract multi-scale feature embeddings, followed by a novel dual-branch transformer that achieves feature reconstruction from local and global perspectives. The local reconstruction employs self-attention, while the global reconstruction incorporates global prototype tokens and semantic query tokens by the aggregation- cross attention mechanism. Moreover, discrepancy normalizing flow is developed to estimate the likelihood of anomalies based on the discrepancy between pre-trained features and local/global reconstruction results. Extensive validation on established public benchmarks confirms that our method achieves state-of-the-art performance with the proposed local-global reconstruction and discrimination dual-stream framework.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Unsupervised Anomaly Detection in Time Series exploiting Local and Global Information
    La Malfa, Emanuele
    La Malfa, Gabriele
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE OF COMPUTATIONAL METHODS IN SCIENCES AND ENGINEERING 2019 (ICCMSE-2019), 2019, 2186
  • [22] TCAD: Unsupervised Anomaly Detection Based on Global Local Representation Differences
    Duan, Yaqiong
    Xiang, Mian
    Zhou, Bingtao
    Fu, Desu
    Liu, Hongxiao
    IEEE Access, 2022, 10 : 114683 - 114693
  • [23] TCAD: Unsupervised Anomaly Detection Based on Global Local Representation Differences
    Duan, Yaqiong
    Xiang, Mian
    Zhou, Bingtao
    Fu, Desu
    Liu, Hongxiao
    IEEE ACCESS, 2022, 10 : 114683 - 114693
  • [24] LGFDR: local and global feature denoising reconstruction for unsupervised anomaly detection
    Chen, Yichi
    Chen, Bin
    Xian, Weizhi
    Wang, Junjie
    Huang, Yao
    Chen, Min
    VISUAL COMPUTER, 2024, 40 (12): : 8881 - 8894
  • [25] Local-to-Global Unsupervised Anomaly Detection from Temporal Data
    Benkabou, Seif-Eddine
    Benabdeslem, Khalid
    Canitia, Bruno
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2017, PT I, 2017, 10234 : 762 - 772
  • [26] Learned Focused Plenoptic Image Compression With Local-Global Correlation Learning
    Liu, Gaosheng
    Yue, Huanjing
    Wen, Bihan
    Yang, Jingyu
    IEEE TRANSACTIONS ON MULTIMEDIA, 2025, 27 : 1216 - 1227
  • [27] Unsupervised Learning for Network Flow based Anomaly Detection in the Era of Deep Learning
    Kabir, Md Ahsanul
    Luo, Xiao
    2020 IEEE SIXTH INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING SERVICE AND APPLICATIONS (BIGDATASERVICE 2020), 2020, : 166 - 169
  • [28] Robust Variational Autoencoders and Normalizing Flows for Unsupervised Network Anomaly Detection
    Najari, Naji
    Berlemont, Samuel
    Lefebvre, Gregoire
    Duffner, Stefan
    Garcia, Christophe
    ADVANCED INFORMATION NETWORKING AND APPLICATIONS, AINA-2022, VOL 2, 2022, 450 : 281 - 292
  • [29] Local-Global Defense against Unsupervised Adversarial Attacks on Graphs
    Jin, Di
    Feng, Bingdao
    Guo, Siqi
    Wang, Xiaobao
    Wei, Jianguo
    Wang, Zhen
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 7, 2023, : 8105 - 8113
  • [30] Normality Learning in Multispace for Video Anomaly Detection
    Zhang, Yu
    Nie, Xiushan
    He, Rundong
    Chen, Meng
    Yin, Yilong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (09) : 3694 - 3706