Pose and Optical Flow Fusion (POFF) for accurate tremor detection and quantification

被引:9
|
作者
Alper, Mehmet Akif [1 ]
Goudreau, John [2 ]
Daniel, Morris [1 ]
机构
[1] Michigan State Univ, Elect & Comp Engn, E Lansing, MI 48824 USA
[2] Michigan State Univ, Movement Disorders Subspecialty Clin, Neurol, E Lansing, MI 48824 USA
关键词
Limb tracking; Contactless; Tremor amplitude and frequency; Temporal alignment; Accelerometer; Kinect; 2; Marker; Parkinson's disease; KINECT; MOVEMENT;
D O I
10.1016/j.bbe.2020.01.009
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Limb tremor measurements are one factor used to characterize and quantify the severity of neurodegenerative disorders. These tremor measurements can also provide dosage-response feedback to guide medication treatments. Here, we propose a system to automatically measure limb tremors in home or clinic settings. The key feature of proposed method is that it is contactless; not requiring a user to wear or hold a device or marker. Our sensor is a Kinect 2, which measures color and depth and estimates rough limb motion. We show that its pose accuracy is poor for small limb tremors below 10 mm amplitude, and so we propose an additional level of tremor tracking that recovers limb motion at a higher precision. Our method upgrades the sensitivity to achieve detection and analysis for tremors down to 2 mm amplitude. We include empirical experiments and measurements showing improved tremor amplitude and frequency estimation using our proposed Pose and Optical Flow Fusion (POFF) algorithm. (c) 2020 Nalecz Institute of Biocybernetics and Biomedical Engineering of the Polish Academy of Sciences. Published by Elsevier B.V. All rights reserved.
引用
收藏
页码:468 / 481
页数:14
相关论文
共 50 条
  • [1] Accurate Pose Tracking for Uncooperative Targets via Data Fusion of Laser Scanner and Optical Camera
    Su, Yu
    Zhang, Zexu
    Wang, Yishi
    Yuan, Mengmeng
    JOURNAL OF THE ASTRONAUTICAL SCIENCES, 2022, 69 (05): : 1375 - 1393
  • [2] Accurate Pose Tracking for Uncooperative Targets via Data Fusion of Laser Scanner and Optical Camera
    Yu Su
    Zexu Zhang
    Yishi Wang
    Mengmeng Yuan
    The Journal of the Astronautical Sciences, 2022, 69 : 1375 - 1393
  • [3] Review of recent patents on detection and quantification of tremor
    Aboy, Mateo
    Crespo, Cristina
    McNames, James
    Sprunger, Joel
    Recent Patents on Biomedical Engineering, 2013, 6 (02): : 89 - 96
  • [4] Accurate Pedestrian Detection by Human Pose Regression
    Zhao, Yun
    Yuan, Zejian
    Chen, Badong
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 1591 - 1605
  • [5] Optical Flow Based Pose Estimation
    Alper, Mehmet Akif
    Al-Ghezi, Hammid
    Nassib, Ali
    Guzel, Yasar
    PROCEEDINGS OF 2018 2ND INTERNATIONAL CONFERENCE ON CLOUD AND BIG DATA COMPUTING (ICCBDC 2018), 2018, : 57 - 60
  • [6] A morphological fusion algorithm for optical detection and quantification of decay patterns on stone surfaces
    Kapsalas, P.
    Maravelaki-Kalaitzaki, P.
    Zervakis, M.
    Delegou, E. T.
    Moropoulou, A.
    CONSTRUCTION AND BUILDING MATERIALS, 2008, 22 (03) : 228 - 238
  • [7] AdaFuse: Adaptive Multiview Fusion for Accurate Human Pose Estimation in the Wild
    Zhang, Zhe
    Wang, Chunyu
    Qiu, Weichao
    Qin, Wenhu
    Zeng, Wenjun
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2021, 129 (03) : 703 - 718
  • [8] AdaFuse: Adaptive Multiview Fusion for Accurate Human Pose Estimation in the Wild
    Zhe Zhang
    Chunyu Wang
    Weichao Qiu
    Wenhu Qin
    Wenjun Zeng
    International Journal of Computer Vision, 2021, 129 : 703 - 718
  • [9] Fusion of Vision and Inertial Sensing for Accurate and Efficient Pose Tracking on Smartphones
    Yang, Xin
    Si, Xun
    Xue, Tangli
    Cheng, Kwang-Ting Tim
    2015 IEEE International Symposium on Mixed and Augmented Reality, 2015, : 68 - 71
  • [10] Decentralized Multi-Camera Fusion for Robust and Accurate Pose Estimation
    Assa, Akbar
    Sharifi, Farrokh Janabi
    2013 IEEE/ASME INTERNATIONAL CONFERENCE ON ADVANCED INTELLIGENT MECHATRONICS (AIM): MECHATRONICS FOR HUMAN WELLBEING, 2013, : 1696 - 1701