A Frequency-Based Attention Neural Network and Subject-Adaptive Transfer Learning for sEMG Hand Gesture Classification

被引:2
|
作者
Nguyen, Phuc Thanh-Thien [1 ]
Su, Shun-Feng [1 ]
Kuo, Chung-Hsien [2 ]
机构
[1] Natl Taiwan Univ Sci & Technol, Dept Elect Taipei, Taipei 106, Taiwan
[2] Natl Taiwan Univ, Dept Mech Engn, Taipei 106, Taiwan
来源
关键词
Feature extraction; Transfer learning; Transforms; Gesture recognition; Neural networks; Muscles; Fast Fourier transforms; Frequency-based attention; fourier transform; short-time fourier transform; class-imbalanced classification; surface electromyography (sEMG);
D O I
10.1109/LRA.2024.3433748
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
This study introduces a novel approach for real-time hand gesture classification through the integration of a Frequency-based Attention Neural Network (FANN) with Subject-Adaptive Transfer Learning, specifically tailored for surface electromyography (sEMG) data. By utilizing the Fourier transform, the proposed methodology leverages the inherent frequency characteristics of sEMG signals to enhance the discriminative features for accurate gesture recognition. Additionally, the subject-adaptive transfer learning strategy is employed to improve model generalization across different individuals. The combination of these techniques results in an effective and versatile system for sEMG-based hand gesture classification, demonstrating promising performance in adapting individual variability and improving classification accuracy. The proposed method's performance is evaluated and compared with established approaches using the publicity available NinaPro DB5 dataset. Notably, the proposed simple model, coupled with frequency-based attention modules, achieves accuracies of 89.56% with a quick prediction time of 5ms, showcasing its potential for dexterous control of robots and bionic hands. The findings of this research contribute to the advancement of gesture recognition systems, particularly in the domains of human-computer interaction and prosthetic control.
引用
收藏
页码:7835 / 7842
页数:8
相关论文
共 50 条
  • [31] Improving sEMG-Based Hand Gesture Recognition Using Maximal Overlap Discrete Wavelet Transform and an Autoencoder Neural Network
    Cruz de Andrade, Fernando Henrique
    Pereira, Flavio Garcia
    Resende, Cassius Zanetti
    Cavalieri, Daniel Cruz
    XXVI BRAZILIAN CONGRESS ON BIOMEDICAL ENGINEERING, CBEB 2018, VOL. 2, 2019, 70 (02): : 271 - 279
  • [32] Transfer learning-based convolutional neural networks with heuristic optimization for hand gesture recognition
    Ozcan, Tayyip
    Basturk, Alper
    NEURAL COMPUTING & APPLICATIONS, 2019, 31 (12): : 8955 - 8970
  • [33] Transfer learning-based convolutional neural networks with heuristic optimization for hand gesture recognition
    Tayyip Ozcan
    Alper Basturk
    Neural Computing and Applications, 2019, 31 : 8955 - 8970
  • [34] Optimization of Deep Neural Network based Hand Gesture Classification Model for Large-Scale Dataset
    Yu, Jie
    Xu, Tao
    Feng, Zhiquan
    Wang, Weifeng
    Ma, Li
    Diao, Xinyi
    PROCEEDINGS OF 2019 2ND INTERNATIONAL CONFERENCE ON BIG DATA TECHNOLOGIES (ICBDT 2019), 2019, : 1 - 5
  • [35] High-Fidelity sEMG Signals Recorded by an on-Skin Electrode Based on AgNWs for Hand Gesture Classification Using Machine Learning
    Zou, Xiaoyang
    Xue, Jiaqi
    Li, Xiaoting
    Chan, Colin Pak Yu
    Li, Ziqi
    Li, Pengyu
    Yang, Zhengbao
    Lai, King Wai Chiu
    ACS APPLIED MATERIALS & INTERFACES, 2023, 15 (15) : 19374 - 19383
  • [36] Image Classification of Pests with Residual Neural Network Based on Transfer Learning
    Li, Chen
    Zhen, Tong
    Li, Zhihui
    APPLIED SCIENCES-BASEL, 2022, 12 (09):
  • [37] Application of Convolutional Neural Network Based on Transfer Learning for Garbage Classification
    Cao, Li
    Xiang, Wei
    PROCEEDINGS OF 2020 IEEE 5TH INFORMATION TECHNOLOGY AND MECHATRONICS ENGINEERING CONFERENCE (ITOEC 2020), 2020, : 1032 - 1036
  • [38] Waste image classification based on transfer learning and convolutional neural network
    Zhang, Qiang
    Yang, Qifan
    Zhang, Xujuan
    Bao, Qiang
    Su, Jinqi
    Liu, Xueyan
    WASTE MANAGEMENT, 2021, 135 (135) : 150 - 157
  • [39] Adaptive transfer learning for EEG motor imagery classification with deep Convolutional Neural Network
    Zhang, Kaishuo
    Robinson, Neethu
    Lee, Seong-Whan
    Guan, Cuntai
    NEURAL NETWORKS, 2021, 136 : 1 - 10
  • [40] Estimation of the convolutional neural network with attention mechanism and transfer learning on wood knot defect classification
    Gao, Mingyu
    Wang, Fei
    Liu, Junyan
    Song, Peng
    Chen, Jianfeng
    Yang, Hong
    Mu, Hongbo
    Qi, Dawei
    Chen, Mingjun
    Wang, Yang
    Yue, Honghao
    JOURNAL OF APPLIED PHYSICS, 2022, 131 (23)