Influence-Aware Attention Networks for Anomaly Detection in Surveillance Videos

被引:47
|
作者
Zhang, Sijia [1 ]
Gong, Maoguo [1 ]
Xie, Yu [1 ]
Qin, A. K. [2 ]
Li, Hao [1 ]
Gao, Yuan [1 ]
Ong, Yew-Soon [3 ]
机构
[1] Xidian Univ, Sch Elect Engn, Minist Educ, Key Lab Intelligent Percept & Image Understanding, Xian 710071, Peoples R China
[2] Swinburne Univ Technol, Dept Comp Sci & Software Engn, Hawthorn, Vic 3122, Australia
[3] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore 639798, Singapore
基金
中国国家自然科学基金; 澳大利亚研究理事会;
关键词
Videos; Anomaly detection; Feature extraction; Generators; Trajectory; Hidden Markov models; Surveillance; Influence-aware attention; GAN;
D O I
10.1109/TCSVT.2022.3148392
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Detecting anomalies in videos is a fundamental issue in public security. The majority of existing deep learning methods often perform anomaly detection based on the behavior or the trajectory of a single target. However, due to the overlaps of the crowd and the low-resolution of monitoring images, the segmentation of population is hard to implement and the features cannot be learned thoroughly, which make the methods be easily disturbed by visual elements and thus may lead to false detection sometimes. To tackle these problems, we propose the influence-aware attention to learn the representative attributes of the whole crowd. Walking pedestrians can be divided into numbers of flows, and in this paper, we aim to measure the consistency of movement patterns in the same stream and the interactions between different streams. Meanwhile, great importance is given to the relation between pedestrians and the circumstance for certain anomalies occur as a result of environmental issues. Specifically, the influence-aware attention module is composed of the motion attention and the location attention, which is designed to quantify the relations in the scene from spatial and temporal aspects. For the lack of abnormal samples, we utilize a dual generator-based framework to learn interactions among normal scenes. Experimental results on six benchmarks verify the effectiveness and robustness of our proposed method.
引用
收藏
页码:5427 / 5437
页数:11
相关论文
共 50 条
  • [1] An Object-aware Anomaly Detection and Localization in Surveillance Videos
    Zang, Xianghao
    Li, Ge
    Li, Zhihao
    Li, Nannan
    Wang, Wenmin
    2016 IEEE SECOND INTERNATIONAL CONFERENCE ON MULTIMEDIA BIG DATA (BIGMM), 2016, : 113 - 116
  • [2] Moving-Object-Aware Anomaly Detection in Surveillance Videos
    Yang, Chun-Lung
    Wu, Tsung-Hsuan
    Lai, Shang-Hong
    2021 17TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE (AVSS 2021), 2021,
  • [3] Deep anomaly detection through visual attention in surveillance videos
    Nasaruddin, Nasaruddin
    Muchtar, Kahlil
    Afdhal, Afdhal
    Dwiyantoro, Alvin Prayuda Juniarta
    JOURNAL OF BIG DATA, 2020, 7 (01)
  • [4] Deep anomaly detection through visual attention in surveillance videos
    Nasaruddin Nasaruddin
    Kahlil Muchtar
    Afdhal Afdhal
    Alvin Prayuda Juniarta Dwiyantoro
    Journal of Big Data, 7
  • [5] Influence-aware graph neural networks
    Yu, Bin
    Zhang, Yu
    Xie, Yu
    Zhang, Chen
    Pan, Ke
    APPLIED SOFT COMPUTING, 2021, 104
  • [6] Anomaly Detection in Surveillance Videos
    Anala, M. R.
    Makker, Malika
    Ashok, Aakanksha
    2019 26TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING, DATA AND ANALYTICS WORKSHOP (HIPCW 2019), 2019, : 93 - 98
  • [7] Anomaly Detection in Surveillance Videos
    Bhakat, Sukalyan
    Ramakrishnan, Ganesh
    PROCEEDINGS OF THE 6TH ACM IKDD CODS AND 24TH COMAD, 2019, : 252 - 255
  • [8] Topological Influence-Aware Recommendation on Social Networks
    Li, Zhaoyi
    Xiong, Fei
    Wang, Ximeng
    Chen, Hongshu
    Xiong, Xi
    COMPLEXITY, 2019, 2019
  • [9] Influence-Aware Attention for Multivariate Temporal Point Processes
    Shou, Xiao
    Gao, Tian
    Subramanian, Dharmashankar
    Bhattacharjya, Debarun
    Bennett, Kristin P.
    CONFERENCE ON CAUSAL LEARNING AND REASONING, VOL 213, 2023, 213 : 499 - 517
  • [10] Object-Aware Skeleton-Based Anomaly Detection in Surveillance Videos
    Moriyama R.
    Kaneko N.
    Sumi K.
    Seimitsu Kogaku Kaishi/Journal of the Japan Society for Precision Engineering, 2023, 89 (12): : 934 - 941