Human Pose Estimation and Gait Analysis with Convolutional Neural Networks for Alzheimer's Disease Detection

被引:0
|
作者
Seifallahi, Mahmoud [1 ]
Farrell, Brennen [1 ]
Galvin, James E. [2 ]
Ghoraani, Behnaz [1 ]
机构
[1] Florida Atlantic Univ, Dept Elect Engn & Comp Sci, Boca Raton, FL 33431 USA
[2] Univ Miami, Comprehens Ctr Brain Hlth, Dept Neurol, Boca Raton, FL 33133 USA
基金
美国国家科学基金会;
关键词
Human pose estimation (HPE); Alzheimer's disease (AD) detection; Convolutional neural networks (CNN); OpenPose; Gait analysis;
D O I
10.1117/12.3013776
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In computer vision, human pose estimation (HPE) through convolutional neural networks (CNNs) has emerged as a promising avenue with broad applicability. This study bridges a novel application of HPE, targeting the early detection of Alzheimer's disease (AD), a condition expected to affect roughly 13.4 million Americans by 2026. Traditionally, AD diagnostic methodologies like brain imaging, Electroencephalography, and blood/neuropsychological tests are not only expensive and protracted but also require specialized medical expertise. Addressing these constraints, we introduce a cost-efficient and universally accessible system to detect AD, harnessing conventional cameras and employing pose estimation, signal processing, and machine learning. Data was sourced from videos capturing a 10-meter curve walk of 73 cognitively healthy older adults (HC) and 34 AD patients. The recording apparatus was a camera offering a resolution of 1920x1080 pixels at 30 frames/second, stationed laterally to the walking path. Using OpenPose, a state-of-the-art, bottom-up multi-person HPE method based on CNNs, we derived 25 distinctive body joint coordinates from the footage. Subsequently, 48 gait parameters were extracted from these joints and subjected to statistical scrutiny. A noticeable difference was observed in 39 out of the 48 gait parameters between the HC and AD groups. Leveraging a Support Vector Machine (SVM) to classify the data, the distinctiveness of these gait markers was further affirmed. The system accomplished a commendable accuracy rate of 90.01% and an F-score of 86.20% for AD identification. In essence, our findings advocate that the amalgamation of everyday cameras, sophisticated HPE techniques, signal processing, and machine learning can pave the way for practical AD detection in non-specialized settings, including home environments.
引用
收藏
页数:13
相关论文
共 50 条
  • [41] Human Age Estimation from Multi-angle Gait Silhouettes with Convolutional Neural Networks
    Kitchat, Kotcharat
    Limcharoen, Piya
    Khamsemanan, Nirattaya
    Nattee, Cholwich
    THAI JOURNAL OF MATHEMATICS, 2022, 20 (03): : 1227 - 1238
  • [42] Age Estimation of Faces in Videos Using Head Pose Estimation and Convolutional Neural Networks
    Zhang, Beichen
    Bao, Yue
    SENSORS, 2022, 22 (11)
  • [43] Convolutional neural networks for classification of Alzheimer's disease: Overview and reproducible evaluation
    Wen, Junhao
    Thibeau-Sutre, Elina
    Diaz-Melo, Mauricio
    Samper-Gonzalez, Jorge
    Routier, Alexandre
    Bottani, Simona
    Dormont, Didier
    Durrleman, Stanley
    Burgos, Ninon
    Colliot, Olivier
    MEDICAL IMAGE ANALYSIS, 2020, 63
  • [44] Diagnosis of Alzheimer's Disease Based on Structural Graph Convolutional Neural Networks
    Lao, Huan
    Jia, Hongfei
    Chen, Zhenhai
    PROCEEDINGS OF THE ACM TURING AWARD CELEBRATION CONFERENCE-CHINA 2024, ACM-TURC 2024, 2024, : 148 - 152
  • [45] Applying Convolutional Neural Networks for Pre-detection of Alzheimer's Disease from Structural MRI data
    Gunawardena, K. A. N. N. P.
    Rajapakse, R. N.
    Kodikara, N. D.
    2017 24TH INTERNATIONAL CONFERENCE ON MECHATRONICS AND MACHINE VISION IN PRACTICE (M2VIP), 2017, : 173 - 179
  • [46] Vehicle Pose Estimation in WAMI Imagery via Deep Convolutional Neural Networks
    Yi, Meng
    Wang, Dong
    Yang, Fan
    Xu, Jonathan
    Cai, Yiran
    Blasch, Erik
    Sheaff, Carolyn
    Chen, Genshe
    Ling, Haibin
    PROCEEDINGS OF THE 2016 IEEE NATIONAL AEROSPACE AND ELECTRONICS CONFERENCE (NAECON) AND OHIO INNOVATION SUMMIT (OIS), 2016, : 233 - 240
  • [47] Pose estimation of optical resonators using convolutional neural networks in a simulation environment
    Melchert, Nils
    Hedrich, Kolja
    Wiese, Leon
    Hinz, Lennart
    Reithmeier, Eduard
    OPTICAL SYSTEM ALIGNMENT, TOLERANCING, AND VERIFICATION XIV, 2022, 12222
  • [48] Global Relation Reasoning Graph Convolutional Networks for Human Pose Estimation
    Wang, Rui
    Huang, Chenyang
    Wang, Xiangyang
    IEEE ACCESS, 2020, 8 : 38472 - 38480
  • [49] Structure-aware human pose estimation with graph convolutional networks
    Bin, Yanrui
    Chen, Zhao-Min
    Wei, Xiu-Shen
    Chen, Xinya
    Gao, Changxin
    Sang, Nong
    PATTERN RECOGNITION, 2020, 106
  • [50] Detection of Violent Behavior Using Neural Networks and Pose Estimation
    Kwan-Loo, Kevin B.
    Ortiz-Bayliss, Jose C.
    Conant-Pablos, Santiago E.
    Terashima-Marin, Hugo
    Rad, P.
    IEEE ACCESS, 2022, 10 : 86339 - 86352