Normality Guided Multiple Instance Learning for Weakly Supervised Video Anomaly Detection

被引:13
|
作者
Park, Seongheon [1 ]
Kim, Hanjae [1 ]
Kim, Minsu [1 ]
Kim, Dahye [1 ]
Sohn, Kwanghoon [1 ,2 ]
机构
[1] Yonsei Univ, Seoul 120749, South Korea
[2] Korea Inst Sci & Technol KIST, Seoul, South Korea
来源
2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV) | 2023年
关键词
D O I
10.1109/WACV56688.2023.00269
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Weakly supervised Video Anomaly Detection (wVAD) aims to distinguish anomalies from normal events based on video-level supervision. Most existing works utilize Multiple Instance Learning (MIL) with ranking loss to tackle this task. These methods, however, rely on noisy predictions from a MIL-based classifier for target instance selection in ranking loss, degrading model performance. To overcome this problem, we propose Normality Guided Multiple Instance Learning (NG-MIL) framework, which encodes diverse normal patterns from noise-free normal videos into prototypes for constructing a similarity-based classifier. By ensembling predictions of two classifiers, our method could refine the anomaly scores, reducing training instability from weak labels. Moreover, we introduce normality clustering and normality guided triplet loss constraining inner bag instances to boost the effect of NG-MIL and increase the discriminability of classifiers. Extensive experiments on three public datasets (ShanghaiTech, UCF-Crime, XD-Violence) demonstrate that our method is comparable to or better than existing weakly supervised methods, achieving stateof-the-art results.
引用
收藏
页码:2664 / 2673
页数:10
相关论文
共 50 条
  • [41] Efficient Multiple Instance Metric Learning using Weakly Supervised Data
    Law, Marc T.
    Yu, Yaoliang
    Urtasun, Raquel
    Zemel, Richard S.
    Xing, Eric P.
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 5948 - 5956
  • [42] Learning Anomalies with Normality Prior for Unsupervised Video Anomaly Detection
    Shi, Haoyue
    Wang, Le
    Zhou, Sanping
    Hua, Gang
    Tang, Wei
    COMPUTER VISION - ECCV 2024, PT VI, 2025, 15064 : 163 - 180
  • [43] Attention-guided MIL weakly supervised visual anomaly detection
    Wang, Lin
    Wang, Xiangjun
    Liu, Feng
    Li, Mingyang
    Hao, Xin
    Zhao, Nianfu
    MEASUREMENT, 2023, 209
  • [44] Attention-based framework for weakly supervised video anomaly detection
    Hualin Ma
    Liyan Zhang
    The Journal of Supercomputing, 2022, 78 : 8409 - 8429
  • [45] Attention-based framework for weakly supervised video anomaly detection
    Ma, Hualin
    Zhang, Liyan
    JOURNAL OF SUPERCOMPUTING, 2022, 78 (06): : 8409 - 8429
  • [46] Weakly-Supervised Video Anomaly Detection with MTDA-Net
    Wu, Huixin
    Yang, Mengfan
    Wei, Fupeng
    Shi, Ge
    Jiang, Wei
    Qiao, Yaqiong
    Dong, Hangcheng
    ELECTRONICS, 2023, 12 (22)
  • [47] Weakly-Supervised Video Anomaly Detection With Snippet Anomalous Attention
    Fan, Yidan
    Yu, Yongxin
    Lu, Wenhuan
    Han, Yahong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (07) : 5480 - 5492
  • [48] Multimodal and multiscale feature fusion for weakly supervised video anomaly detection
    Sun, Wenwen
    Cao, Lin
    Guo, Yanan
    Du, Kangning
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [49] Video anomaly detection guided by clustering learning
    Qiu, Shaoming
    Ye, Jingfeng
    Zhao, Jiancheng
    He, Lei
    Liu, Liangyu
    E, Bicong
    Huang, Xinchen
    PATTERN RECOGNITION, 2024, 153
  • [50] Weakly Supervised Object Detection Using Complementary Learning and Instance Clustering
    Awan, Mehwish
    Shin, Jitae
    IEEE ACCESS, 2020, 8 : 103419 - 103432