SKIP: Accurate Fall Detection Based on Skeleton Keypoint Association and Critical Feature Perception

被引:1
|
作者
Du, Chenjie [1 ]
Jin, Ran [1 ]
Tang, Hao [2 ]
Jiang, Qiuping [3 ]
He, Zhiwei [4 ]
机构
[1] Zhejiang Wanli Univ, Coll Big Data & Software Engn, Ningbo 315100, Peoples R China
[2] Swiss Fed Inst Technol, Dept Informat Technol & Elect Engn, CH-8092 Zurich, Switzerland
[3] Ningbo Univ, Fac Informat Sci & Engn, Ningbo 315211, Peoples R China
[4] Hangzhou Dianzi Univ, Fac Elect Informat, Hangzhou 310018, Peoples R China
关键词
Critical feature perception (CFP); cross-frame association; fall detection; skeleton keypoints; RECOGNITION;
D O I
10.1109/JSEN.2024.3379167
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
As deep learning technology advances, human fall detection (HFD) leveraging convolutional neural networks (CNNs) has recently garnered significant interest within the research community. However, most existing works ignore the cross-frame association of skeleton keypoints and aggregation of feature representations. To address this, we first introduce an image preprocessing (IPP) module, which enhances the foreground and weakens the background. Diverging from common practices that employ the off-the-shelf detector for target position estimation, our skeleton keypoint detection and association (SKDA) module is designed to detect and cross-frame associate the skeleton keypoints with high affinity. This design reduces the misleading impact of ambiguous detections and ensures the continuity of long-range trajectories. Further, our critical feature perception (CFP) module is crafted to help the model learn more discriminative feature representations for human activity classification. Incorporating these components mentioned above, we introduce SKIP, a novel human fall detection approach, showcasing improved detection precision. Evaluations on the publicly available telecommunication system team v2 (TSTv2) and self-build datasets show SKIP's superior performance.
引用
收藏
页码:14812 / 14824
页数:13
相关论文
共 50 条
  • [31] Hand-dorsa Vein Recognition based on Multi-level Keypoint Detection and Local Feature Matching
    Tang, Yinhang
    Huang, Di
    Wang, Yunhong
    2012 21ST INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR 2012), 2012, : 2837 - 2840
  • [32] Copy-move tampering detection using keypoint based hybrid feature extraction and improved transformation model
    K Sunitha
    A N Krishna
    B G Prasad
    Applied Intelligence, 2022, 52 : 15405 - 15416
  • [33] Implementation of Fall Detection System Based on 3D Skeleton for Deep Learning Technique
    Tsai, Tsung-Han
    Hsu, Chin-Wei
    IEEE ACCESS, 2019, 7 : 153049 - 153059
  • [34] Fall detection based on LCNN and fusion model of weights using human skeleton and optical flow
    Cao, Yingchan
    Guo, Ming
    Sun, Jianqiang
    Chen, Xiangyong
    Qiu, Jianlong
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (01) : 833 - 841
  • [35] An Analysis of Synthetic Data for Improving Performance of Skeleton-Based Fall Down Detection Models
    Park, Jimin
    Kim, Bongjun
    Jeong, Junho
    2024 5TH INTERNATIONAL CONFERENCE ON BIG DATA ANALYTICS AND PRACTICES, IBDAP, 2024, : 89 - 92
  • [36] Fall detection based on LCNN and fusion model of weights using human skeleton and optical flow
    Yingchan Cao
    Ming Guo
    Jianqiang Sun
    Xiangyong Chen
    Jianlong Qiu
    Signal, Image and Video Processing, 2024, 18 : 833 - 841
  • [37] Human-skeleton based Fall-Detection Method using LSTM for Manufacturing Industries
    Jeong, Sungil
    Kang, Sungjoo
    Chun, Ingeol
    2019 34TH INTERNATIONAL TECHNICAL CONFERENCE ON CIRCUITS/SYSTEMS, COMPUTERS AND COMMUNICATIONS (ITC-CSCC 2019), 2019, : 314 - 317
  • [38] FALL DETECTION BASED ON MOTION HISTORY IMAGE AND HISTOGRAM OF ORIENTED GRADIENT FEATURE
    Feng, Qi
    Gao, Chenqiang
    Wang, Lan
    Zhang, Minwen
    Du, Lian
    Qin, Shiyu
    2017 INTERNATIONAL SYMPOSIUM ON INTELLIGENT SIGNAL PROCESSING AND COMMUNICATION SYSTEMS (ISPACS 2017), 2017, : 341 - 346
  • [39] Discrete Variational Feature Transfer Learning for Skeleton-based Abnormal Behavior Detection
    Shu, Yuan
    Wang, Youren
    Zhang, Min
    Yang, Jie
    Wang, Yi
    Wang, Jun
    Zhang, Yunbin
    INTERNATIONAL JOURNAL ON ARTIFICIAL INTELLIGENCE TOOLS, 2024, 33 (07)
  • [40] Impact of Feature Normalization on Machine Learning-Based Human Fall Detection
    Fayad, Moustafa
    Hachani, Mohamed-Yacine
    Mostefaoui, Ahmed
    Merzoug, Mohammed Amine
    Lajoie, Isabelle
    Yahiaoui, Reda
    MANAGEMENT OF DIGITAL ECOSYSTEMS, MEDES 2023, 2024, 2022 : 147 - 161