Local-global normality learning and discrepancy normalizing flow for unsupervised image anomaly detection

被引:0
|
作者
Yao, Haiming [1 ]
Luo, Wei [1 ]
Zhang, Weihang [2 ]
Zhang, Xiaotian [1 ]
Qiang, Zhenfeng [1 ]
Luo, Donghao [1 ]
机构
[1] Tsinghua Univ, State Key Lab Precis Measurement Technol & Instrum, Beijing 100084, Peoples R China
[2] Beijing Inst Technol, Sch Med Technol, Beijing 100081, Peoples R China
关键词
Unsupervised anomaly detection; Global-local semantics learning; Dual-branch vision transformer; Discrepancy normalizing flow;
D O I
10.1016/j.engappai.2024.109235
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The unsupervised detection and localization of image anomalies hold significant importance across various domains, particularly in industrial quality inspection. Despite its widespread utilization, this task remains inherently challenging due to its reliance solely on defect-free normal knowledge. This paper presents the local- global normality learning and discrepancy normalizing flow, a new state-of-the-art model for unsupervised image anomaly detection and localization. In contrast to existing methods, It adopts a two-stream approach that considers both local and global semantics, ensuring stable detection of abnormalities. The framework comprises two key components: the dual-branch Transformer and the discrepancy normalizing flow, facilitating reconstruction and discrimination. The proposed framework leverages pre-trained convolutional neural networks to extract multi-scale feature embeddings, followed by a novel dual-branch transformer that achieves feature reconstruction from local and global perspectives. The local reconstruction employs self-attention, while the global reconstruction incorporates global prototype tokens and semantic query tokens by the aggregation- cross attention mechanism. Moreover, discrepancy normalizing flow is developed to estimate the likelihood of anomalies based on the discrepancy between pre-trained features and local/global reconstruction results. Extensive validation on established public benchmarks confirms that our method achieves state-of-the-art performance with the proposed local-global reconstruction and discrimination dual-stream framework.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detection
    Gong, Dong
    Liu, Lingqiao
    Le, Vuong
    Saha, Budhaditya
    Mansour, Moussa Reda
    Venkatesh, Svetha
    van den Hengel, Anton
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 1705 - 1714
  • [42] Local-global visual interaction attention for image captioning
    Wang, Changzhi
    Gu, Xiaodong
    DIGITAL SIGNAL PROCESSING, 2022, 130
  • [43] An unsupervised deep global-local views model for anomaly detection in attributed networks
    Lei, Tianyang
    Ou, Mengxin
    Gong, Chang
    Li, Jichao
    Yang, Kewei
    KNOWLEDGE-BASED SYSTEMS, 2024, 300
  • [44] UNSUPERVISED ANOMALY DETECTION WITH LOCAL-SENSITIVE VQVAE AND GLOBAL-SENSITIVE TRANSFORMERS
    Wang, Mingqing
    Li, Jiawei
    Li, Zhenyang
    Luo, Chengxiao
    Chen, Bin
    Xia, Shu-Tao
    Wang, Zhi
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 1080 - 1084
  • [45] Local-global coordination with transformers for referring image segmentation
    Liu, Fang
    Kong, Yuqiu
    Zhang, Lihe
    Feng, Guang
    Yin, Baocai
    NEUROCOMPUTING, 2023, 522 : 39 - 52
  • [46] Effective Local-Global Transformer for Natural Image Matting
    Hu, Liangpeng
    Kong, Yating
    Li, Jide
    Li, Xiaoqiang
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (08) : 3888 - 3898
  • [47] Normality learning reinforcement for anomaly detection in surveillance videos
    Cheng, Kai
    Zeng, Xinhua
    Liu, Yang
    Pan, Yaning
    Li, Xinzhe
    KNOWLEDGE-BASED SYSTEMS, 2024, 297
  • [48] Manifold learning techniques for unsupervised anomaly detection
    Olson, C. C.
    Judd, K. P.
    Nichols, J. M.
    EXPERT SYSTEMS WITH APPLICATIONS, 2018, 91 : 374 - 385
  • [49] Anomaly Detection through Unsupervised Federated Learning
    Nardi, Mirko
    Valerio, Lorenzo
    Passarella, Andrea
    2022 18TH INTERNATIONAL CONFERENCE ON MOBILITY, SENSING AND NETWORKING, MSN, 2022, : 495 - 501
  • [50] Conditional normalizing flow for multivariate time series anomaly detection
    Guan, Siwei
    He, Zhiwei
    Ma, Shenhui
    Gao, Mingyu
    ISA TRANSACTIONS, 2023, 143 : 231 - 243