Normality Guided Multiple Instance Learning for Weakly Supervised Video Anomaly Detection

被引:13
|
作者
Park, Seongheon [1 ]
Kim, Hanjae [1 ]
Kim, Minsu [1 ]
Kim, Dahye [1 ]
Sohn, Kwanghoon [1 ,2 ]
机构
[1] Yonsei Univ, Seoul 120749, South Korea
[2] Korea Inst Sci & Technol KIST, Seoul, South Korea
来源
2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV) | 2023年
关键词
D O I
10.1109/WACV56688.2023.00269
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Weakly supervised Video Anomaly Detection (wVAD) aims to distinguish anomalies from normal events based on video-level supervision. Most existing works utilize Multiple Instance Learning (MIL) with ranking loss to tackle this task. These methods, however, rely on noisy predictions from a MIL-based classifier for target instance selection in ranking loss, degrading model performance. To overcome this problem, we propose Normality Guided Multiple Instance Learning (NG-MIL) framework, which encodes diverse normal patterns from noise-free normal videos into prototypes for constructing a similarity-based classifier. By ensembling predictions of two classifiers, our method could refine the anomaly scores, reducing training instability from weak labels. Moreover, we introduce normality clustering and normality guided triplet loss constraining inner bag instances to boost the effect of NG-MIL and increase the discriminability of classifiers. Extensive experiments on three public datasets (ShanghaiTech, UCF-Crime, XD-Violence) demonstrate that our method is comparable to or better than existing weakly supervised methods, achieving stateof-the-art results.
引用
收藏
页码:2664 / 2673
页数:10
相关论文
共 50 条
  • [31] BatchNorm-Based Weakly Supervised Video Anomaly Detection
    Zhou, Yixuan
    Qu, Yi
    Xu, Xing
    Shen, Fumin
    Song, Jingkuan
    Tao Shen, Heng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (12) : 13642 - 13654
  • [32] Pyramidal Multiple Instance Detection Network With Mask Guided Self-Correction for Weakly Supervised Object Detection
    Xu, Yunqiu
    Zhou, Chunluan
    Yu, Xin
    Xiao, Bin
    Yang, Yi
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 3029 - 3040
  • [33] Parallel Detection-and-Segmentation Learning for Weakly Supervised Instance
    Shen, Yunhang
    Cao, Liujuan
    Chen, Zhiwei
    Zhang, Baochang
    Su, Chi
    Wu, Yongjian
    Huang, Feiyue
    Ji, Rongrong
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 8178 - 8188
  • [34] Contrastive Transformer-Based Multiple Instance Learning for Weakly Supervised Polyp Frame Detection
    Tian, Yu
    Pang, Guansong
    Liu, Fengbei
    Liu, Yuyuan
    Wang, Chong
    Chen, Yuanhong
    Verjans, Johan
    Carneiro, Gustavo
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT III, 2022, 13433 : 88 - 98
  • [35] WEAKLY-SUPERVISED DIAGNOSIS AND DETECTION OF BREAST CANCER USING DEEP MULTIPLE INSTANCE LEARNING
    Diogo, Pedro
    Morais, Margarida
    Calisto, Francisco Maria
    Santiago, Carlos
    Aleluia, Clara
    Nascimento, Jacinto C.
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [36] Salient-aware multiple instance learning optimized network for weakly supervised object detection
    Zhang, Han
    Wang, Yongfang
    Yang, Yingjie
    VISUAL COMPUTER, 2024, 40 (11): : 8227 - 8242
  • [37] Multiple Instance Deep Learning for Weakly Supervised Small-Footprint Audio Event Detection
    Tseng, Shao-Yen
    Li, Juncheng
    Wang, Yun
    Metze, Florian
    Szurley, Joseph
    Das, Samarjit
    19TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2018), VOLS 1-6: SPEECH RESEARCH FOR EMERGING MARKETS IN MULTILINGUAL SOCIETIES, 2018, : 3279 - 3283
  • [38] Multiple instance learning on deep features for weakly supervised object detection with extreme domain shifts
    Nicolas, Gonthier
    Ladjal, Said
    Gousseau, Yann
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2022, 214
  • [39] Weakly Supervised Video Anomaly Detection via Transformer-Enabled Temporal Relation Learning
    Zhang, Dasheng
    Huang, Chao
    Liu, Chengliang
    Xu, Yong
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 1197 - 1201
  • [40] Learning Prompt-Enhanced Context Features for Weakly-Supervised Video Anomaly Detection
    Pu, Yujiang
    Wu, Xiaoyu
    Yang, Lulu
    Wang, Shengjin
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 4923 - 4936