Real-Time Multimodal Feedback with the CPR Tutor

被引:11
|
作者
Di Mitri, Daniele [1 ]
Schneider, Jan [2 ]
Trebing, Kevin [3 ]
Sopka, Sasa [4 ]
Specht, Marcus [5 ]
Drachsler, Hendrik [1 ,2 ]
机构
[1] Open Univ Netherlands, Valkenburgerweg 177, NL-6419 AT Heerlen, Netherlands
[2] DIPF Leibniz Inst Res & Informat Educ, Frankfurt, Germany
[3] Maastricht Univ, Maastricht, Netherlands
[4] AIXTRA RWTH Aachen Univ Hosp, Aachen, Germany
[5] Delft Univ Technol, Delft, Netherlands
关键词
D O I
10.1007/978-3-030-52237-7_12
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We developed the CPR Tutor, a real-time multimodal feedback system for cardiopulmonary resuscitation (CPR) training. The CPR Tutor detects mistakes using recurrent neural networks for real-time time-series classification. From a multimodal data stream consisting of kinematic and electromyographic data, the CPR Tutor system automatically detects the chest compressions, which are then classified and assessed according to five performance indicators. Based on this assessment, the CPR Tutor provides audio feedback to correct the most critical mistakes and improve the CPR performance. To test the validity of the CPR Tutor, we first collected the data corpus from 10 experts used for model training. Hence, to test the impact of the feedback functionality, we ran a user study involving 10 participants. The CPR Tutor pushes forward the current state of the art of real-time multimodal tutors by providing: 1) an architecture design, 2) a methodological approach to design multimodal feedback and 3) a field study on real-time feedback for CPR training.
引用
收藏
页码:141 / 152
页数:12
相关论文
共 50 条
  • [31] Real-Time Output Feedback Neurolinearization
    Bahreini, Rabeheh
    Boozarjomehry, Bozorgmehry Ramin
    IRANIAN JOURNAL OF CHEMISTRY & CHEMICAL ENGINEERING-INTERNATIONAL ENGLISH EDITION, 2009, 28 (02): : 121 - 130
  • [32] REAL-TIME FEEDBACK FOR PRODUCTION LITHOGRAPHY
    DUNN, PN
    SOLID STATE TECHNOLOGY, 1993, 36 (10) : 28 - +
  • [33] Experiments in real-time quantum feedback
    Mabuchi, H
    PROCEEDINGS OF THE 41ST IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-4, 2002, : 450 - 451
  • [34] Real-time calibration of a feedback trap
    Gavrilov, Momcilo
    Jun, Yonggun
    Bechhoefer, John
    REVIEW OF SCIENTIFIC INSTRUMENTS, 2014, 85 (09):
  • [35] Reply to: Real-time audiovisual feedback during CPR: A clarification, meta-analysis update, and caution for interpretation
    Wang, Shao-An
    Su, Chan-Ping
    Fan, Hsien-Yu
    Hou, Wen-Hsuan
    Chen, Yang-Ching
    RESUSCITATION, 2021, 158 : 298 - 300
  • [36] Improving CPR quality with distributed practice and real-time feedback in pediatric healthcare providers - A randomized controlled trial
    Lin, Yiqun
    Cheng, Adam
    Grant, Vincent J.
    Currie, Gillian R.
    Hecker, Kent G.
    RESUSCITATION, 2018, 130 : 6 - 12
  • [37] Effective CPR Procedure With Real Time Evaluation and Feedback Using Smartphones
    Gupta, Neeraj K.
    Dantu, Vishnu
    Dantu, Ram
    IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE, 2014, 2
  • [38] Real-time visual feedback during training improves laypersons' CPR quality: a randomized controlled manikin study
    Baldi, Enrico
    Cornara, Stefano
    Contri, Enrico
    Epis, Francesco
    Fina, Dario
    Zelaschi, Beatrice
    Dossena, Cinzia
    Fichtner, Ferdinando
    Tonani, Michela
    DiMaggio, Marzia
    Zambaiti, Elisa
    Somaschini, Alberto
    CANADIAN JOURNAL OF EMERGENCY MEDICINE, 2017, 19 (06) : 480 - 487
  • [39] CPR quality improvement during in-hospital cardiac arrest using a real-time audiovisual feedback system
    Abella, Benjamin S.
    Edelson, Dana P.
    Kim, Salem
    Retzer, Elizabeth
    Myklebust, Helge
    Barry, Anne M.
    O'Hearn, Nicholas
    Hoek, Terry L. Vanden
    Becker, Lance B.
    RESUSCITATION, 2007, 73 (01) : 54 - 61
  • [40] Development of a real-time feedback algorithm for chest compression during CPR without assuming full chest decompression
    Dellimore, Gohier K. H.
    Scheffer, C.
    RESUSCITATION, 2014, 85 (06) : 820 - 825