Transfer Learning Enhanced Cross-Subject Hand Gesture Recognition with sEMG

被引:2
|
作者
Zhang, Shenyilang [1 ]
Fang, Yinfeng [1 ]
Wan, Jiacheng [1 ]
Jiang, Guozhang [2 ]
Li, Gongfa [2 ]
机构
[1] Hangzhou Dianzi Univ, Sch Commun Engn, Hangzhou 310018, Zhejiang, Peoples R China
[2] Wuhan Univ Sci & Technol, Wuhan 430081, Hubei, Peoples R China
关键词
Feature combination; Hand gesture classification; Transfer learning; Alexnet; EMG SIGNALS;
D O I
10.1007/s40846-023-00837-5
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
PurposeThis study explores the emerging field of human physical action classification within human-machine interaction (HMI), with potential applications in assisting individuals with disabilities and robotics. The research focuses on addressing the challenges posed by diverse sEMG signals, aiming for improved cross-subject hand gesture recognition.MethodsThe proposed approach utilizes deep transfer learning technology, employing multi-feature images (MFI) generated through grayscale conversion and RGB mapping of numerical matrices. These MFIs are fed as input into a fine-tuned AlexNet model. Two databases, ISRMyo-I and Ninapro DB1, are employed for experimentation. Rigorous testing is conducted to identify optimal parameters and feature combinations. Data augmentation techniques are applied, doubling the MFI dataset. Cross-subject experiments encompass six wrist gestures from Ninapro DB1 and thirteen gestures from ISRMyo-I.ResultsThe study demonstrates substantial performance enhancements. In Ninapro DB1, the mean accuracy achieves 86.16%, showcasing a 13.25% improvement over the best-performing traditional decoding method. Similarly, in ISRMyo-I, a mean accuracy of 70.41% is attained, signifying a 7.4% increase in accuracy compared to traditional methods.ConclusionThis research establishes a robust framework capable of mitigating cross-user differences in hand gesture recognition based on sEMG signals. By employing deep transfer learning techniques and multi-feature image processing, the study significantly enhances the accuracy of cross-subject hand gesture recognition. This advancement holds promise for enriching human-machine interaction and extending the practical applications of this technology in assisting disabled individuals and robotics.
引用
收藏
页码:672 / 688
页数:17
相关论文
共 50 条
  • [21] Online cross session electromyographic hand gesture recognition using deep learning and transfer learning
    Zhang, Zhen
    Liu, Shilong
    Wang, Yanyu
    Song, Wei
    Zhang, Yuhui
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 127
  • [22] Joint EEG Feature Transfer and Semisupervised Cross-Subject Emotion Recognition
    Peng, Yong
    Liu, Honggang
    Kong, Wanzeng
    Nie, Feiping
    Lu, Bao-Liang
    Cichocki, Andrzej
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (07) : 8104 - 8115
  • [23] Contrastive Learning of Subject-Invariant EEG Representations for Cross-Subject Emotion Recognition
    Shen, Xinke
    Liu, Xianggen
    Hu, Xin
    Zhang, Dan
    Song, Sen
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2023, 14 (03) : 2496 - 2511
  • [24] Comprehensive Multisource Learning Network for Cross-Subject Multimodal Emotion Recognition
    Chen, Chuangquan
    Li, Zhencheng
    Kou, Kit Ian
    Du, Jie
    Li, Chen
    Wang, Hongtao
    Vong, Chi-Man
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2025, 9 (01): : 365 - 380
  • [25] Cross-Subject and Cross-Modal Transfer for Generalized Abnormal Gait Pattern Recognition
    Gu, Xiao
    Guo, Yao
    Deligianni, Fani
    Lo, Benny
    Yang, Guang-Zhong
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (02) : 546 - 560
  • [26] sEMG-Based Gesture Recognition With Embedded Virtual Hand Poses Adversarial Learning
    Hu, Yu
    Wong, Yongkang
    Dai, Qingfeng
    Kankanhalli, Mohan
    Geng, Weidong
    Li, Xiangdong
    IEEE ACCESS, 2019, 7 : 104108 - 104120
  • [27] sEMG Signal Features Extraction and Machine Learning Based Gesture Recognition for Prosthesis Hand
    Fatayerji, Hala
    Al Talib, Rabab
    Alqurashi, Asmaa
    Qaisar, Saeed Mian
    2022 FIFTH INTERNATIONAL CONFERENCE OF WOMEN IN DATA SCIENCE AT PRINCE SULTAN UNIVERSITY (WIDS-PSU 2022), 2022, : 166 - 171
  • [28] sEMG based hand gesture recognition for rehabilitation prosthetics based on machine learning methods
    Escobedo-Gordillo, Andres
    Sepulveda, Miguel
    Villa, Jesus
    Villanueva, Ximena
    Garcia-Casas, Sebastian
    Diaz, Fernando
    Brieva, Jorge
    Moya-Albor, Ernesto
    Ponce, Hiram
    2023 19TH INTERNATIONAL SYMPOSIUM ON MEDICAL INFORMATION PROCESSING AND ANALYSIS, SIPAIM, 2023,
  • [29] Hand Gesture Recognition via Transient sEMG Using Transfer Learning of Dilated Efficient CapsNet: Towards Generalization for Neurorobotics
    Tyacke, Eion
    Reddy, Shreyas P. J.
    Feng, Natalie
    Edlabadkar, Rama
    Zhou, Shucong
    Patel, Jay
    Hu, Qin
    Atashzar, S. Farokh
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (04) : 9216 - 9223
  • [30] KL Divergence-based transfer learning for cross-subject eye movement recognition with EOG signals
    Su, RuiZhi
    Zeng, Zheng
    Tao, LinKai
    Wang, ZaiHao
    Chen, Chen
    Chen, Wei
    2023 45TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY, EMBC, 2023,