Transfer Learning Enhanced Cross-Subject Hand Gesture Recognition with sEMG

被引:2
|
作者
Zhang, Shenyilang [1 ]
Fang, Yinfeng [1 ]
Wan, Jiacheng [1 ]
Jiang, Guozhang [2 ]
Li, Gongfa [2 ]
机构
[1] Hangzhou Dianzi Univ, Sch Commun Engn, Hangzhou 310018, Zhejiang, Peoples R China
[2] Wuhan Univ Sci & Technol, Wuhan 430081, Hubei, Peoples R China
关键词
Feature combination; Hand gesture classification; Transfer learning; Alexnet; EMG SIGNALS;
D O I
10.1007/s40846-023-00837-5
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
PurposeThis study explores the emerging field of human physical action classification within human-machine interaction (HMI), with potential applications in assisting individuals with disabilities and robotics. The research focuses on addressing the challenges posed by diverse sEMG signals, aiming for improved cross-subject hand gesture recognition.MethodsThe proposed approach utilizes deep transfer learning technology, employing multi-feature images (MFI) generated through grayscale conversion and RGB mapping of numerical matrices. These MFIs are fed as input into a fine-tuned AlexNet model. Two databases, ISRMyo-I and Ninapro DB1, are employed for experimentation. Rigorous testing is conducted to identify optimal parameters and feature combinations. Data augmentation techniques are applied, doubling the MFI dataset. Cross-subject experiments encompass six wrist gestures from Ninapro DB1 and thirteen gestures from ISRMyo-I.ResultsThe study demonstrates substantial performance enhancements. In Ninapro DB1, the mean accuracy achieves 86.16%, showcasing a 13.25% improvement over the best-performing traditional decoding method. Similarly, in ISRMyo-I, a mean accuracy of 70.41% is attained, signifying a 7.4% increase in accuracy compared to traditional methods.ConclusionThis research establishes a robust framework capable of mitigating cross-user differences in hand gesture recognition based on sEMG signals. By employing deep transfer learning techniques and multi-feature image processing, the study significantly enhances the accuracy of cross-subject hand gesture recognition. This advancement holds promise for enriching human-machine interaction and extending the practical applications of this technology in assisting disabled individuals and robotics.
引用
收藏
页码:672 / 688
页数:17
相关论文
共 50 条
  • [31] Enhanced Lightweight CNN Using Joint Classification With Averaging Probability for sEMG-Based Subject-Independent Hand Gesture Recognition
    Leelakittisin, Benjakarn
    Trakulruangroj, Manatsanan
    Sangnark, Soravitt
    Wilaiprasitporn, Theerawit
    Sudhawiyangkul, Thapanun
    IEEE SENSORS JOURNAL, 2023, 23 (17) : 20348 - 20356
  • [32] Multi-Source Integration based Transfer Learning Method for Cross-User sEMG Gesture Recognition
    Wang, Kang
    Chen, Yiqiang
    Zhang, Yingwei
    Yang, Xiaodong
    Hu, Chunyu
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [33] Cross-Subject Motor Imagery Decoding by Transfer Learning of Tactile ERD
    Zhong, Yucun
    Yao, Lin
    Pan, Gang
    Wang, Yueming
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2024, 32 : 662 - 671
  • [34] Cross-Subject Seizure Detection in EEGs Using Deep Transfer Learning
    Zhang, Baocan
    Wang, Wennan
    Xiao, Yutian
    Xiao, Shixiao
    Chen, Shuaichen
    Chen, Sirui
    Xu, Gaowei
    Che, Wenliang
    COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE, 2020, 2020
  • [35] Muscle Connectivity Analysis for Hand Gesture Recognition via sEMG
    Lin, Yuzhou
    De Wilde, Philippe
    Palaniappan, Ramaswamy
    Li, Ling
    2018 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2018, : 848 - 852
  • [36] sEMG based hand gesture recognition with deformable convolutional network
    Hao Wang
    Yue Zhang
    Chao Liu
    Honghai Liu
    International Journal of Machine Learning and Cybernetics, 2022, 13 : 1729 - 1738
  • [37] Cross-Subject Emotion Recognition Based on Domain Similarity of EEG Signal Transfer
    Ma, Yuliang
    Zhao, Weicheng
    Meng, Ming
    Zhang, Qizhong
    She, Qingshan
    Zhang, Jianhai
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2023, 31 : 936 - 943
  • [38] Feature Fusion of sEMG and Ultrasound Signals in Hand Gesture Recognition
    Zeng, Jia
    Zhou, Yu
    Yang, Yicheng
    Wang, Jiaole
    Liu, Honghai
    2020 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2020, : 3911 - 3916
  • [39] Hand Gesture Recognition of sEMG Based on Modified Kohonen Network
    Zhang Li
    Tian Yantao
    Li Yang
    2011 INTERNATIONAL CONFERENCE ON ELECTRONICS, COMMUNICATIONS AND CONTROL (ICECC), 2011, : 1476 - 1479
  • [40] Comparing Cross-Subject Performance on Human Activities Recognition Using Learning Models
    Yang, Zhe
    Qu, Mengjie
    Pan, Yun
    Huan, Ruohong
    IEEE ACCESS, 2022, 10 : 95179 - 95196