Influence-Aware Attention Networks for Anomaly Detection in Surveillance Videos

被引:47
|
作者
Zhang, Sijia [1 ]
Gong, Maoguo [1 ]
Xie, Yu [1 ]
Qin, A. K. [2 ]
Li, Hao [1 ]
Gao, Yuan [1 ]
Ong, Yew-Soon [3 ]
机构
[1] Xidian Univ, Sch Elect Engn, Minist Educ, Key Lab Intelligent Percept & Image Understanding, Xian 710071, Peoples R China
[2] Swinburne Univ Technol, Dept Comp Sci & Software Engn, Hawthorn, Vic 3122, Australia
[3] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore 639798, Singapore
基金
中国国家自然科学基金; 澳大利亚研究理事会;
关键词
Videos; Anomaly detection; Feature extraction; Generators; Trajectory; Hidden Markov models; Surveillance; Influence-aware attention; GAN;
D O I
10.1109/TCSVT.2022.3148392
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Detecting anomalies in videos is a fundamental issue in public security. The majority of existing deep learning methods often perform anomaly detection based on the behavior or the trajectory of a single target. However, due to the overlaps of the crowd and the low-resolution of monitoring images, the segmentation of population is hard to implement and the features cannot be learned thoroughly, which make the methods be easily disturbed by visual elements and thus may lead to false detection sometimes. To tackle these problems, we propose the influence-aware attention to learn the representative attributes of the whole crowd. Walking pedestrians can be divided into numbers of flows, and in this paper, we aim to measure the consistency of movement patterns in the same stream and the interactions between different streams. Meanwhile, great importance is given to the relation between pedestrians and the circumstance for certain anomalies occur as a result of environmental issues. Specifically, the influence-aware attention module is composed of the motion attention and the location attention, which is designed to quantify the relations in the scene from spatial and temporal aspects. For the lack of abnormal samples, we utilize a dual generator-based framework to learn interactions among normal scenes. Experimental results on six benchmarks verify the effectiveness and robustness of our proposed method.
引用
收藏
页码:5427 / 5437
页数:11
相关论文
共 50 条
  • [21] IBaggedFCNet: An Ensemble Framework for Anomaly Detection in Surveillance Videos
    Zahid, Yumna
    Tahir, Muhammad Atif
    Durrani, Nouman M.
    Bouridane, Ahmed
    IEEE ACCESS, 2020, 8 : 220620 - 220630
  • [22] Real-world Anomaly Detection in Surveillance Videos
    Sultani, Waqas
    Chen, Chen
    Shah, Mubarak
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 6479 - 6488
  • [23] OBJECT-ORIENTED ANOMALY DETECTION IN SURVEILLANCE VIDEOS
    Li, Xiaodan
    Li, Weihai
    Liu, Bin
    Liu, Qiankun
    Yu, Nenghai
    2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 1907 - 1911
  • [24] Anomaly Detection in Videos Recorded by Drones in a Surveillance Context
    Henrio, Jordan
    Nakashima, Tomoharu
    2018 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2018, : 2503 - 2508
  • [25] Anomaly detection by exploiting the tracking trajectory in surveillance videos
    Zixuan XUE
    Wei WU
    Science China(Information Sciences), 2020, 63 (05) : 197 - 199
  • [26] Joint Representation Learning for Anomaly Detection in Surveillance Videos
    Saypadith, Savath
    Onoye, Takao
    2022 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS 22), 2022,
  • [27] Anomaly detection by exploiting the tracking trajectory in surveillance videos
    Xue, Zixuan
    Wu, Wei
    SCIENCE CHINA-INFORMATION SCIENCES, 2020, 63 (05)
  • [28] Target Analysis Based Anomaly Detection in Surveillance Videos
    Zhang, Jie
    Li, Weihai
    TWELFTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2020), 2020, 11519
  • [29] Normality learning reinforcement for anomaly detection in surveillance videos
    Cheng, Kai
    Zeng, Xinhua
    Liu, Yang
    Pan, Yaning
    Li, Xinzhe
    KNOWLEDGE-BASED SYSTEMS, 2024, 297
  • [30] Anomaly detection in surveillance videos using deep autoencoder
    Mishra S.
    Jabin S.
    International Journal of Information Technology, 2024, 16 (2) : 1111 - 1122