A Global and Local Feature fused CNN architecture for the sEMG-based hand gesture recognition

被引:19
|
作者
Xiong, Baoping [1 ]
Chen, Wensheng [1 ]
Niu, Yinxi [1 ]
Gan, Zhenhua [1 ]
Mao, Guojun [1 ]
Xu, Yong [1 ]
机构
[1] Fujian Univ Technol, Comp Sci & Math, Fuzhou 350116, Fujian, Peoples R China
关键词
sEMG; Hand gestures classification; CNN; Global and local feature fusion; Feature map; EMG; CLASSIFICATION; INFORMATION; ROBUST;
D O I
10.1016/j.compbiomed.2023.107497
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Deep learning methods have been widely used for the classification of hand gestures using sEMG signals. Existing deep learning architectures only captures local spatial information and has limitations in extracting global temporal dependency to enhance the model's performance. In this paper, we propose a Global and Local Feature fused CNN (GLF-CNN) model that extracts features both globally and locally from sEMG signals to enhance the performance of hand gestures classification. The model contains two independent branches extracting local and global features each and fuses them to learn more diversified features and effectively improve the stability of gesture recognition. Besides, it also exhibits lower computational cost compared to the present approaches. We conduct experiments on five benchmark databases, including the NinaPro DB4, NinaPro DB5, BioPatRec DB1-DB3, and the Mendeley Data. The proposed model achieved the highest average accuracy of 88.34% on these databases, with a 9.96% average accuracy improvement and a 50% reduction in variance compared to the models with the same number of parameters. Moreover, the classification accuracies for the BioPatRec DB1, BioPatRec DB3 and Mendeley Data are 91.4%, 91.0% and 88.6% respectively, corresponding to an improvement of 13.2%, 41.5% and 12.2% over the respective state-of-the-art models. The experimental results demonstrate that the proposed model effectively enhances robustness, with improved gesture recognition performance and generalization ability. It contributes a new way for prosthetic control and human-machine interaction.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] A Novel SE-CNN Attention Architecture for sEMG-Based Hand Gesture Recognition
    Xu, Zhengyuan
    Yu, Junxiao
    Xiang, Wentao
    Zhu, Songsheng
    Hussain, Mubashir
    Liu, Bin
    Li, Jianqing
    CMES-COMPUTER MODELING IN ENGINEERING & SCIENCES, 2023, 134 (01): : 157 - 177
  • [2] A novel concatenate feature fusion RCNN architecture for sEMG-based hand gesture recognition
    Xu, Pufan
    Li, Fei
    Wang, Haipeng
    PLOS ONE, 2022, 17 (01):
  • [3] Selection of the Best Set of Features for sEMG-Based Hand Gesture Recognition Applying a CNN Architecture
    Sandoval-Espino, Jorge Arturo
    Zamudio-Lara, Alvaro
    Marban-Salgado, Jose Antonio
    Escobedo-Alatorre, J. Jesus
    Palillero-Sandoval, Omar
    Velasquez-Aguilar, J. Guadalupe
    SENSORS, 2022, 22 (13)
  • [4] A sEMG-Based Hand Gesture Recognition Using Mulit-channel CNN and MLP
    Li, Zhengzhen
    Li, Ke
    Wei, Na
    2020 13TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI 2020), 2020, : 867 - 871
  • [5] A Multi-Scale CNN for Transfer Learning in sEMG-Based Hand Gesture Recognition for Prosthetic Devices
    Fratti, Riccardo
    Marini, Niccolo
    Atzori, Manfredo
    Mueller, Henning
    Tiengo, Cesare
    Bassetto, Franco
    SENSORS, 2024, 24 (22)
  • [6] sEMG-Based Hand Gesture Recognition Using Binarized Neural Network
    Kang, Soongyu
    Kim, Haechan
    Park, Chaewoon
    Sim, Yunseong
    Lee, Seongjoo
    Jung, Yunho
    SENSORS, 2023, 23 (03)
  • [7] A novel attention-based hybrid CNN-RN N architecture for sEMG-based gesture recognition
    Hu, Yu
    Wong, Yongkang
    Wei, Wentao
    Du, Yu
    Kankanhalli, Mohan
    Geng, Weidong
    PLOS ONE, 2018, 13 (10):
  • [8] Hand Gesture Recognition using sEMG Signals Based on CNN
    Li Bo
    Yang Banghua
    Gao Shouwei
    Yan, LinFeng
    Zhuang, Haodong
    Wang, Wen
    2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 7180 - 7184
  • [9] Toward Generalization of sEMG-Based Pattern Recognition: A Novel Feature Extraction for Gesture Recognition
    Shen, Cheng
    Pei, Zhongcai
    Chen, Weihai
    Wang, Jianhua
    Zhang, Jianbin
    Chen, Zuobing
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [10] SEMG-BASED HAND GESTURE RECOGNITION VIA DILATED CONVOLUTIONAL NEURAL NETWORKS
    Rahimian, Elahe
    Zabihi, Soheil
    Atashzar, S. Farokh
    Asif, Amir
    Mohammadi, Arash
    2019 7TH IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (IEEE GLOBALSIP), 2019,