A Frequency-Based Attention Neural Network and Subject-Adaptive Transfer Learning for sEMG Hand Gesture Classification

被引:2
|
作者
Nguyen, Phuc Thanh-Thien [1 ]
Su, Shun-Feng [1 ]
Kuo, Chung-Hsien [2 ]
机构
[1] Natl Taiwan Univ Sci & Technol, Dept Elect Taipei, Taipei 106, Taiwan
[2] Natl Taiwan Univ, Dept Mech Engn, Taipei 106, Taiwan
来源
关键词
Feature extraction; Transfer learning; Transforms; Gesture recognition; Neural networks; Muscles; Fast Fourier transforms; Frequency-based attention; fourier transform; short-time fourier transform; class-imbalanced classification; surface electromyography (sEMG);
D O I
10.1109/LRA.2024.3433748
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
This study introduces a novel approach for real-time hand gesture classification through the integration of a Frequency-based Attention Neural Network (FANN) with Subject-Adaptive Transfer Learning, specifically tailored for surface electromyography (sEMG) data. By utilizing the Fourier transform, the proposed methodology leverages the inherent frequency characteristics of sEMG signals to enhance the discriminative features for accurate gesture recognition. Additionally, the subject-adaptive transfer learning strategy is employed to improve model generalization across different individuals. The combination of these techniques results in an effective and versatile system for sEMG-based hand gesture classification, demonstrating promising performance in adapting individual variability and improving classification accuracy. The proposed method's performance is evaluated and compared with established approaches using the publicity available NinaPro DB5 dataset. Notably, the proposed simple model, coupled with frequency-based attention modules, achieves accuracies of 89.56% with a quick prediction time of 5ms, showcasing its potential for dexterous control of robots and bionic hands. The findings of this research contribute to the advancement of gesture recognition systems, particularly in the domains of human-computer interaction and prosthetic control.
引用
收藏
页码:7835 / 7842
页数:8
相关论文
共 50 条
  • [11] A novel sEMG-based dynamic hand gesture recognition approach via residual attention network
    Liu, Yanhong
    Li, Xingyu
    Yu, Hongnian
    Yang, Lei
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (03) : 9329 - 9349
  • [12] DeepTPA-Net: A Deep Triple Attention Network for sEMG-Based Hand Gesture Recognition
    Li, Qingqing
    Luo, Zhirui
    Qi, Ruobin
    Zheng, Jun
    IEEE ACCESS, 2023, 11 : 96797 - 96807
  • [13] A novel sEMG-based dynamic hand gesture recognition approach via residual attention network
    Yanhong Liu
    Xingyu Li
    Hongnian Yu
    Lei Yang
    Multimedia Tools and Applications, 2024, 83 : 9329 - 9349
  • [14] Content-Adaptive and Attention-Based Network for Hand Gesture Recognition
    Cao, Zongjing
    Li, Yan
    Shin, Byeong-Seok
    APPLIED SCIENCES-BASEL, 2022, 12 (04):
  • [15] Subject-Adaptive Transfer Learning Using Resting State EEG Signals for Cross-Subject EEG Motor Imagery Classification
    An, Sion
    Kang, Myeongkyun
    Kim, Soopil
    Chikontwe, Philip
    Shen, Li
    Park, Sang Hyun
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT XI, 2024, 15011 : 678 - 688
  • [16] Multistage Spatial Attention-Based Neural Network for Hand Gesture Recognition
    Miah, Abu Saleh Musa
    Hasan, Md. Al Mehedi
    Shin, Jungpil
    Okuyama, Yuichi
    Tomioka, Yoichi
    COMPUTERS, 2023, 12 (01)
  • [17] Hand Gesture Recognition based on Surface Electromyography using Convolutional Neural Network with Transfer Learning Method
    Chen, Xiang
    Li, Yu
    Hu, Ruochen
    Zhang, Xu
    Chen, Xun
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2021, 25 (04) : 1292 - 1304
  • [18] Hand Gesture Classification Using Inertial Based Sensors via a Neural Network
    Akan, Erhan
    Tora, Hakan
    Uslu, Baran
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON ELECTRONICS, CIRCUITS AND SYSTEMS (ICECS), 2017, : 140 - 143
  • [19] Hand Gesture Classification Based on Nonaudible Sound Using Convolutional Neural Network
    Kim, Jinhyuck
    Choi, Sunwoong
    JOURNAL OF SENSORS, 2019, 2019
  • [20] A Multi-Scale CNN for Transfer Learning in sEMG-Based Hand Gesture Recognition for Prosthetic Devices
    Fratti, Riccardo
    Marini, Niccolo
    Atzori, Manfredo
    Mueller, Henning
    Tiengo, Cesare
    Bassetto, Franco
    SENSORS, 2024, 24 (22)