Improved Transfer Learning for Detecting Upper-Limb Movement Intention Using Mechanical Sensors in an Exoskeletal Rehabilitation System

被引:0
|
作者
Choi, Ahnryul [1 ]
Kim, Tae Hyong [2 ,3 ]
Chae, Seungheon [2 ]
Mun, Joung Hwan [2 ]
机构
[1] Chungbuk Natl Univ, Coll Med, Dept Biomed Engn, Cheongju 28644, Chungbuk, South Korea
[2] Sungkyunkwan Univ, Coll Biotechnol & Bioengn, Dept Biomechatron Engn, Suwon 16419, Gyeonggi, South Korea
[3] Korea Food Res Inst, Digital Factory Project Grp, Wanju 55365, South Korea
关键词
Brain modeling; Electromyography; Transfer learning; Robot sensing systems; Mechanical sensors; Exoskeletons; Accuracy; Predictive models; Data models; Classification algorithms; Upper-limb motion intention; exoskeletal rehabilitation system; mechanical sensor; transfer learning; CIFAR-ResNet18; CIFAR-MobileNetV2; STROKE; ROBOT; MOTION; MODEL;
D O I
10.1109/TNSRE.2024.3486444
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
The objective of this study was to propose a novel strategy for detecting upper-limb motion intentions from mechanical sensor signals using deep and heterogeneous transfer learning techniques. Three sensor types, surface electromyography (sEMG), force-sensitive resistors (FSRs), and inertial measurement units (IMUs), were combined to capture biometric signals during arm-up, hold, and arm-down movements. To distinguish motion intentions, deep learning models were constructed using the CIFAR-ResNet18 and CIFAR-MobileNetV2 architectures. The input features of the source models were sEMG, FSR, and IMU signals. The target model was trained using only FSR and IMU sensor signals. Optimization techniques determined appropriate layer structures and learning rates of each layer for effective transfer learning. The source model on CIFAR-ResNet18 exhibited the highest performance, achieving an accuracy of 95% and an F-1 score of 0.95. The target model with optimization strategies performed comparably to the source model, achieving an accuracy of 93% and an F-1 score of 0.93. The results show that mechanical sensors alone can achieve performance comparable to models including sEMG. The proposed approach can serve as a convenient and precise algorithm for human-robot collaboration in rehabilitation assistant robots.
引用
收藏
页码:3953 / 3965
页数:13
相关论文
共 28 条
  • [1] Using Orientation Sensors to Control a FES System for Upper-Limb Motor Rehabilitation
    Ruiz-Olaya, Andres F.
    Lopez-Delis, Alberto
    da Rocha, Adson Ferreira
    BIOINFORMATICS AND BIOMEDICAL ENGINEERING (IWBBIO 2018), PT II, 2019, 10814 : 95 - 105
  • [2] Learning and Transfer Methods for Active Rehabilitation Strategy of Upper-limb Rehabilitation Robot
    Guo, Shijie
    Song, Yuanhao
    Wang, Xusheng
    Liu, Zuojun
    Li, Yang
    Jiqiren/Robot, 46 (05): : 562 - 575
  • [3] Improving sEMG-based motion intention recognition for upper-limb amputees using transfer learning
    Jinghua Fan
    Mingzhe Jiang
    Chuang Lin
    Gloria Li
    Jinan Fiaidhi
    Chenfei Ma
    Wanqing Wu
    Neural Computing and Applications, 2023, 35 : 16101 - 16111
  • [4] Improving sEMG-based motion intention recognition for upper-limb amputees using transfer learning
    Fan, Jinghua
    Jiang, Mingzhe
    Lin, Chuang
    Li, Gloria
    Fiaidhi, Jinan
    Ma, Chenfei
    Wu, Wanqing
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (22): : 16101 - 16111
  • [5] Towards a Gaze-Informed Movement Intention Model for Robot-Assisted Upper-Limb Rehabilitation
    Crocher, Vincent
    Singh, Ronal
    Newn, Joshua
    Oetomo, Denny
    2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, : 6155 - 6158
  • [6] Recognition of Upper-limb Movement Using Electroencephalogram Signals with Deep Learning
    Wahid, Md Ferdous
    Tafreshi, Reza
    2020 IEEE 5TH MIDDLE EAST AND AFRICA CONFERENCE ON BIOMEDICAL ENGINEERING (MECBME), 2020, : 1 - 6
  • [7] DESIGN OF A SYSTEM FOR UPPER-LIMB REHABILITATION BASED ON AN ELECTROMECHANICAL ORTHOSIS AND SEMG WIRELESS SENSORS
    Gentile, Marco
    Iuale, Matteo
    Mengoni, Maura
    Germani, Michele
    PROCEEDINGS OF THE ASME INTERNATIONAL DESIGN ENGINEERING TECHNICAL CONFERENCES AND COMPUTERS AND INFORMATION IN ENGINEERING CONFERENCE, 2013, VOL 4, 2014,
  • [8] Adaptive Learning based Upper-Limb Rehabilitation Training System with Collaborative Robot
    Lim, Jun Hong
    He, Kaibo
    Yi, Zeji
    Hou, Chen
    Zhang, Chen
    Sui, Yanan
    Li, Luming
    2023 45TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY, EMBC, 2023,
  • [9] Using UHF RFID Properties to Develop and Optimize an Upper-Limb Rehabilitation System
    Baccinelli, Walter
    Bulgheroni, Maria
    Frigo, Carlo Albino
    SENSORS, 2020, 20 (11) : 1 - 15
  • [10] Toward Improved Sensorimotor Integration and Learning Using Upper-limb Prosthetic Devices
    Gillespie, R. Brent
    Contreras-Vidal, Jose Luis
    Shewokis, Patricia A.
    Malley, Marcia K. O.
    Brown, Jeremy D.
    Agashe, Harshavardhan
    Gentili, Rodolphe
    Davis, Alicia
    2010 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2010, : 5077 - 5080