Improved Transfer Learning for Detecting Upper-Limb Movement Intention Using Mechanical Sensors in an Exoskeletal Rehabilitation System

被引:0
|
作者
Choi, Ahnryul [1 ]
Kim, Tae Hyong [2 ,3 ]
Chae, Seungheon [2 ]
Mun, Joung Hwan [2 ]
机构
[1] Chungbuk Natl Univ, Coll Med, Dept Biomed Engn, Cheongju 28644, Chungbuk, South Korea
[2] Sungkyunkwan Univ, Coll Biotechnol & Bioengn, Dept Biomechatron Engn, Suwon 16419, Gyeonggi, South Korea
[3] Korea Food Res Inst, Digital Factory Project Grp, Wanju 55365, South Korea
关键词
Brain modeling; Electromyography; Transfer learning; Robot sensing systems; Mechanical sensors; Exoskeletons; Accuracy; Predictive models; Data models; Classification algorithms; Upper-limb motion intention; exoskeletal rehabilitation system; mechanical sensor; transfer learning; CIFAR-ResNet18; CIFAR-MobileNetV2; STROKE; ROBOT; MOTION; MODEL;
D O I
10.1109/TNSRE.2024.3486444
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
The objective of this study was to propose a novel strategy for detecting upper-limb motion intentions from mechanical sensor signals using deep and heterogeneous transfer learning techniques. Three sensor types, surface electromyography (sEMG), force-sensitive resistors (FSRs), and inertial measurement units (IMUs), were combined to capture biometric signals during arm-up, hold, and arm-down movements. To distinguish motion intentions, deep learning models were constructed using the CIFAR-ResNet18 and CIFAR-MobileNetV2 architectures. The input features of the source models were sEMG, FSR, and IMU signals. The target model was trained using only FSR and IMU sensor signals. Optimization techniques determined appropriate layer structures and learning rates of each layer for effective transfer learning. The source model on CIFAR-ResNet18 exhibited the highest performance, achieving an accuracy of 95% and an F-1 score of 0.95. The target model with optimization strategies performed comparably to the source model, achieving an accuracy of 93% and an F-1 score of 0.93. The results show that mechanical sensors alone can achieve performance comparable to models including sEMG. The proposed approach can serve as a convenient and precise algorithm for human-robot collaboration in rehabilitation assistant robots.
引用
收藏
页码:3953 / 3965
页数:13
相关论文
共 28 条
  • [11] Improvement of Sense of Agency During Upper-Limb Movement for Motor Rehabilitation Using Virtual Reality
    Aoyagi, Kei
    Wen, Wen
    An, Qi
    Hamasaki, Shunsuke
    Yamakawa, Hiroshi
    Tamura, Yusuke
    Yamashita, Atsushi
    Asama, Hajime
    2019 41ST ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2019, : 118 - 121
  • [12] Bilateral upper-limb rehabilitation after stroke using a movement-based game controller
    Hijmans, Juha M.
    Hale, Leigh A.
    Satherley, Jessica A.
    McMillan, Nicole J.
    King, Marcus J.
    JOURNAL OF REHABILITATION RESEARCH AND DEVELOPMENT, 2011, 48 (08): : 1005 - 1013
  • [13] Upper-limb rehabilitation system using haptic device with basic motion training program
    Takahashi, Y
    Terada, T
    Inoue, K
    Ito, Y
    Lee, H
    Ikeda, Y
    Komeda, T
    PROCEEDINGS OF THE 25TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, VOLS 1-4: A NEW BEGINNING FOR HUMAN HEALTH, 2003, 25 : 1621 - 1624
  • [14] A Home-based FES System for Upper-limb Stroke Rehabilitation with Iterative Learning Control
    Kutlu, Mustafa
    Freeman, Chris
    Hughes, Ann-Marie
    Spraggs, Matthew
    IFAC PAPERSONLINE, 2017, 50 (01): : 12089 - 12094
  • [15] Basic Experiment on Rehabilitation of Upper-Limb Motor Function Using Haptic-Device System
    Lee, Ho Kyoo
    Kim, Young Tark
    Takahashi, Yoshiyuki
    Miyoshi, Tasuku
    Suzuki, Keisuke
    Komeda, Takashi
    TRANSACTIONS OF THE KOREAN SOCIETY OF MECHANICAL ENGINEERS A, 2011, 35 (05) : 459 - 467
  • [16] Detecting Movement Intent from Scalp EEG in a Novel Upper Limb Robotic Rehabilitation System for Stroke
    Bhagat, Nikunj A.
    French, James
    Venkatakrishnan, Anusha
    Yozbatiran, Nuray
    Francisco, Gerard E.
    O'Malley, Marcia K.
    Contreras-Vidal, Jose L.
    2014 36TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2014, : 4127 - 4130
  • [17] EMG-Based Intention Detection Using Deep Learning for Shared Control in Upper-Limb Assistive Exoskeletons
    Sedighi, Paniz
    Li, Xingyu
    Tavakoli, Mahdi
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (01): : 41 - 48
  • [18] Studying upper-limb kinematics using inertial sensors: A cross-sectional study Sports Science, Medicine and Rehabilitation
    Roldán-Jiménez C.
    Cuesta-Vargas A.I.
    BMC Research Notes, 8 (1)
  • [19] Development of an Upper Limb Rehabilitation System using Inertial Movement Units and Kinect device
    Chen, Pei-Jarn
    Du, Yi-Chun
    Shih, Cheng-Bang
    Yang, Li-Cheng
    Lin, Hui-Ting
    Fan, Shih-Chen
    PROCEEDINGS OF THE IEEE INTERNATIONAL CONFERENCE ON ADVANCED MATERIALS FOR SCIENCE AND ENGINEERING (IEEE-ICAMSE 2016), 2016, : 275 - 278
  • [20] Upper Limb Rehabilitation System for Stroke Survivors Based on Multi-Modal Sensors and Machine Learning
    Miao, Sheng
    Shen, Chen
    Feng, Xiaochen
    Zhu, Qixiu
    Shorfuzzaman, Mohammad
    Lv, Zhihan
    IEEE Access, 2021, 9 : 30283 - 30291