Local-global normality learning and discrepancy normalizing flow for unsupervised image anomaly detection

被引:0
|
作者
Yao, Haiming [1 ]
Luo, Wei [1 ]
Zhang, Weihang [2 ]
Zhang, Xiaotian [1 ]
Qiang, Zhenfeng [1 ]
Luo, Donghao [1 ]
机构
[1] Tsinghua Univ, State Key Lab Precis Measurement Technol & Instrum, Beijing 100084, Peoples R China
[2] Beijing Inst Technol, Sch Med Technol, Beijing 100081, Peoples R China
关键词
Unsupervised anomaly detection; Global-local semantics learning; Dual-branch vision transformer; Discrepancy normalizing flow;
D O I
10.1016/j.engappai.2024.109235
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The unsupervised detection and localization of image anomalies hold significant importance across various domains, particularly in industrial quality inspection. Despite its widespread utilization, this task remains inherently challenging due to its reliance solely on defect-free normal knowledge. This paper presents the local- global normality learning and discrepancy normalizing flow, a new state-of-the-art model for unsupervised image anomaly detection and localization. In contrast to existing methods, It adopts a two-stream approach that considers both local and global semantics, ensuring stable detection of abnormalities. The framework comprises two key components: the dual-branch Transformer and the discrepancy normalizing flow, facilitating reconstruction and discrimination. The proposed framework leverages pre-trained convolutional neural networks to extract multi-scale feature embeddings, followed by a novel dual-branch transformer that achieves feature reconstruction from local and global perspectives. The local reconstruction employs self-attention, while the global reconstruction incorporates global prototype tokens and semantic query tokens by the aggregation- cross attention mechanism. Moreover, discrepancy normalizing flow is developed to estimate the likelihood of anomalies based on the discrepancy between pre-trained features and local/global reconstruction results. Extensive validation on established public benchmarks confirms that our method achieves state-of-the-art performance with the proposed local-global reconstruction and discrimination dual-stream framework.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Conditional Normalizing Flow with Multiscale Local-global Features Learning for Low-light Image Enhancement
    Hu, Yin
    Hu, Changhui
    Xu, Lintao
    2024 9TH INTERNATIONAL CONFERENCE ON SIGNAL AND IMAGE PROCESSING, ICSIP, 2024, : 272 - 276
  • [2] Rethinking prediction-based video anomaly detection from local-global normality perspective
    Zhao, Mengyang
    Zeng, Xinhua
    Liu, Yang
    Liu, Jing
    Pang, Chengxin
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 262
  • [3] Advancing unsupervised anomaly detection with normalizing flow and multi-scale ensemble learning
    Campos-Romero, Miguel
    Carranza-Garcia, Manuel
    Riquelme, Jose C.
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 137
  • [4] Learning Anomalies with Normality Prior for Unsupervised Video Anomaly Detection
    Shi, Haoyue
    Wang, Le
    Zhou, Sanping
    Hua, Gang
    Tang, Wei
    COMPUTER VISION - ECCV 2024, PT VI, 2025, 15064 : 163 - 180
  • [5] Unsupervised anomaly detection using graph neural networks integrated with physical-statistical feature fusion and local-global learning
    Feng, Chenlong
    Liu, Chao
    Jiang, Dongxiang
    RENEWABLE ENERGY, 2023, 206 : 309 - 323
  • [6] LOCAL-GLOBAL BACKGROUND MODELING FOR ANOMALY DETECTION IN HYPERSPECTRAL IMAGES
    Madar, Eyal
    Kuybeda, Oleg
    Malah, David
    Barzohar, Meir
    2009 FIRST WORKSHOP ON HYPERSPECTRAL IMAGE AND SIGNAL PROCESSING: EVOLUTION IN REMOTE SENSING, 2009, : 368 - 371
  • [7] MSAttnFlow: Normalizing flow for unsupervised anomaly detection with multi-scale attention
    Hu, Zhengnan
    Zeng, Xiangrui
    Li, Yiqun
    Yin, Zhouping
    Meng, Erli
    Wei, Ziyu
    Zhu, Leyan
    Wang, Zitian
    PATTERN RECOGNITION, 2025, 161
  • [8] UniFlow: Unified Normalizing Flow for Unsupervised Multi-Class Anomaly Detection
    Zhong, Jianmei
    Song, Yanzhi
    Information (Switzerland), 2024, 15 (12)
  • [9] Enhancing Local-Global Representation Learning for Image Restoration
    Cui, Yuning
    Knoll, Alois
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2024, 20 (04) : 6522 - 6530
  • [10] Unsupervised Anomaly Detection and Localization Based on Two-Hierarchy Normalizing Flow
    Jiang, Jielin
    Wei, Shun
    Xu, Xiaolong
    Cui, Yan
    Liu, Xiying
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73