SKIP: Accurate Fall Detection Based on Skeleton Keypoint Association and Critical Feature Perception

被引:1
|
作者
Du, Chenjie [1 ]
Jin, Ran [1 ]
Tang, Hao [2 ]
Jiang, Qiuping [3 ]
He, Zhiwei [4 ]
机构
[1] Zhejiang Wanli Univ, Coll Big Data & Software Engn, Ningbo 315100, Peoples R China
[2] Swiss Fed Inst Technol, Dept Informat Technol & Elect Engn, CH-8092 Zurich, Switzerland
[3] Ningbo Univ, Fac Informat Sci & Engn, Ningbo 315211, Peoples R China
[4] Hangzhou Dianzi Univ, Fac Elect Informat, Hangzhou 310018, Peoples R China
关键词
Critical feature perception (CFP); cross-frame association; fall detection; skeleton keypoints; RECOGNITION;
D O I
10.1109/JSEN.2024.3379167
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
As deep learning technology advances, human fall detection (HFD) leveraging convolutional neural networks (CNNs) has recently garnered significant interest within the research community. However, most existing works ignore the cross-frame association of skeleton keypoints and aggregation of feature representations. To address this, we first introduce an image preprocessing (IPP) module, which enhances the foreground and weakens the background. Diverging from common practices that employ the off-the-shelf detector for target position estimation, our skeleton keypoint detection and association (SKDA) module is designed to detect and cross-frame associate the skeleton keypoints with high affinity. This design reduces the misleading impact of ambiguous detections and ensures the continuity of long-range trajectories. Further, our critical feature perception (CFP) module is crafted to help the model learn more discriminative feature representations for human activity classification. Incorporating these components mentioned above, we introduce SKIP, a novel human fall detection approach, showcasing improved detection precision. Evaluations on the publicly available telecommunication system team v2 (TSTv2) and self-build datasets show SKIP's superior performance.
引用
收藏
页码:14812 / 14824
页数:13
相关论文
共 50 条
  • [1] KAMTFENet: a fall detection algorithm based on keypoint attention module and temporal feature extraction
    Jiangjiao Li
    Mengqi Gao
    Bin Li
    Dazheng Zhou
    Yumin Zhi
    Youmei Zhang
    International Journal of Machine Learning and Cybernetics, 2023, 14 : 1831 - 1844
  • [2] KAMTFENet: a fall detection algorithm based on keypoint attention module and temporal feature extraction
    Li, Jiangjiao
    Gao, Mengqi
    Li, Bin
    Zhou, Dazheng
    Zhi, Yumin
    Zhang, Youmei
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2023, 14 (05) : 1831 - 1844
  • [3] Skeleton based efficient fall detection
    Aslan, Muzaffer
    Akbulut, Yaman
    Sengur, Abdulkadir
    Ince, Melih Cevdet
    JOURNAL OF THE FACULTY OF ENGINEERING AND ARCHITECTURE OF GAZI UNIVERSITY, 2017, 32 (04): : 1025 - 1034
  • [4] Skeleton based efficient fall detection
    Aslan M.
    Akbulut Y.
    Šengör A.
    CevdetInce M.
    Aslan, Muzaffer (muzaffer.aslan@gmail.com), 1600, Gazi Universitesi (32): : 1025 - 1034
  • [5] Skeleton Based Fall Detection with Convolutional Neural Network
    Wu, Jun
    Wang, Ke
    Cheng, Baoping
    Li, Ruifeng
    Chen, Changfan
    Zhou, Tianxiang
    PROCEEDINGS OF THE 2019 31ST CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2019), 2019, : 5266 - 5271
  • [6] A Keypoint-based Global Association Network for Lane Detection
    Wang, Jinsheng
    Ma, Yinchao
    Huang, Shaofei
    Hui, Tianrui
    Wang, Fei
    Qian, Chen
    Zhang, Tianzhu
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 1382 - 1391
  • [7] A keypoint-based object detection method with attention mechanism and feature fusion
    Wang, Hui
    Yang, Tangwen
    2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 2113 - 2118
  • [8] Combinatorial detection of ship and its wake via skeleton theory based on joint feature knowledge association
    Qian Y.
    Chen Q.
    Qian W.
    Yu X.
    Ren K.
    Wan M.
    Kong X.
    Wang F.
    Optik, 2023, 288
  • [9] An Improved Feature-Based Method for Fall Detection
    Yao, Leiyue
    Yang, Wei
    Huang, Wei
    TEHNICKI VJESNIK-TECHNICAL GAZETTE, 2019, 26 (05): : 1363 - 1368
  • [10] Differentiative Feature-based Fall Detection System
    Chotipant, Supannada
    Jamsri, Pornsuree
    2021 21ST INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS 2021), 2021, : 359 - 364