Local-global normality learning and discrepancy normalizing flow for unsupervised image anomaly detection

被引:0
|
作者
Yao, Haiming [1 ]
Luo, Wei [1 ]
Zhang, Weihang [2 ]
Zhang, Xiaotian [1 ]
Qiang, Zhenfeng [1 ]
Luo, Donghao [1 ]
机构
[1] Tsinghua Univ, State Key Lab Precis Measurement Technol & Instrum, Beijing 100084, Peoples R China
[2] Beijing Inst Technol, Sch Med Technol, Beijing 100081, Peoples R China
关键词
Unsupervised anomaly detection; Global-local semantics learning; Dual-branch vision transformer; Discrepancy normalizing flow;
D O I
10.1016/j.engappai.2024.109235
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The unsupervised detection and localization of image anomalies hold significant importance across various domains, particularly in industrial quality inspection. Despite its widespread utilization, this task remains inherently challenging due to its reliance solely on defect-free normal knowledge. This paper presents the local- global normality learning and discrepancy normalizing flow, a new state-of-the-art model for unsupervised image anomaly detection and localization. In contrast to existing methods, It adopts a two-stream approach that considers both local and global semantics, ensuring stable detection of abnormalities. The framework comprises two key components: the dual-branch Transformer and the discrepancy normalizing flow, facilitating reconstruction and discrimination. The proposed framework leverages pre-trained convolutional neural networks to extract multi-scale feature embeddings, followed by a novel dual-branch transformer that achieves feature reconstruction from local and global perspectives. The local reconstruction employs self-attention, while the global reconstruction incorporates global prototype tokens and semantic query tokens by the aggregation- cross attention mechanism. Moreover, discrepancy normalizing flow is developed to estimate the likelihood of anomalies based on the discrepancy between pre-trained features and local/global reconstruction results. Extensive validation on established public benchmarks confirms that our method achieves state-of-the-art performance with the proposed local-global reconstruction and discrimination dual-stream framework.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Global-Local Association Discrepancy for Multivariate Time Series Anomaly Detection in IIoT
    Zhou, Xiaobo
    Dai, Cuini
    Wang, Weixu
    Qiu, Tie
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (07) : 11287 - 11297
  • [32] Learning Unsupervised Metaformer for Anomaly Detection
    Wu, Jhih-Ciang
    Chen, Ding-Jie
    Fuh, Chiou-Shann
    Liu, Tyng-Luh
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 4349 - 4358
  • [33] Traffic Anomaly Detection Via Conditional Normalizing Flow
    Kang, Zhuangwei
    Mukhopadhyay, Ayan
    Gokhale, Aniruddha
    Wen, Shijie
    Dubey, Abhishek
    2022 IEEE 25TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2022, : 2563 - 2570
  • [34] An Implementation of Combined Local-Global Optical Flow
    Jara-Wilde, Jorge
    Cerda, Mauricio
    Delpiano, Jose
    Haertel, Steffen
    IMAGE PROCESSING ON LINE, 2015, 5 : 139 - 158
  • [35] Local-Global Attentive Adaptation for Object Detection
    Zhang, Dan
    Li, Jingjing
    Li, Xingpeng
    Du, Zhekai
    Xiong, Lin
    Ye, Mao
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2021, 100
  • [36] Unsupervised deep learning system for local anomaly event detection in crowded scenes
    Anitha Ramchandran
    Arun Kumar Sangaiah
    Multimedia Tools and Applications, 2020, 79 : 35275 - 35295
  • [37] Unsupervised deep learning system for local anomaly event detection in crowded scenes
    Ramchandran, Anitha
    Sangaiah, Arun Kumar
    MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (47-48) : 35275 - 35295
  • [38] A Combined Local-Global Optical Flow Approach for Cranial Ultrasonogram Image Sequence Analysis
    Ahmad, Mohiuddin
    Taslima, Taohida
    Lata, Lutfunnesa
    Yamada, Masayoshi
    2008 11TH INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION TECHNOLOGY: ICCIT 2008, VOLS 1 AND 2, 2008, : 654 - +
  • [39] Unsupervised video anomaly detection via normalizing flows with implicit latent features
    Cho, MyeongAh
    Kim, Taeoh
    Kim, Woo Jin
    Cho, Suhwan
    Lee, Sangyoun
    PATTERN RECOGNITION, 2022, 129
  • [40] Focus the Discrepancy: Intra- and Inter-Correlation Learning for Image Anomaly Detection
    Yao, Xincheng
    Li, Ruoqi
    Qian, Zefeng
    Luo, Yan
    Zhang, Chongyang
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 6780 - 6790