A Frequency-Based Attention Neural Network and Subject-Adaptive Transfer Learning for sEMG Hand Gesture Classification

被引:2
|
作者
Nguyen, Phuc Thanh-Thien [1 ]
Su, Shun-Feng [1 ]
Kuo, Chung-Hsien [2 ]
机构
[1] Natl Taiwan Univ Sci & Technol, Dept Elect Taipei, Taipei 106, Taiwan
[2] Natl Taiwan Univ, Dept Mech Engn, Taipei 106, Taiwan
来源
关键词
Feature extraction; Transfer learning; Transforms; Gesture recognition; Neural networks; Muscles; Fast Fourier transforms; Frequency-based attention; fourier transform; short-time fourier transform; class-imbalanced classification; surface electromyography (sEMG);
D O I
10.1109/LRA.2024.3433748
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
This study introduces a novel approach for real-time hand gesture classification through the integration of a Frequency-based Attention Neural Network (FANN) with Subject-Adaptive Transfer Learning, specifically tailored for surface electromyography (sEMG) data. By utilizing the Fourier transform, the proposed methodology leverages the inherent frequency characteristics of sEMG signals to enhance the discriminative features for accurate gesture recognition. Additionally, the subject-adaptive transfer learning strategy is employed to improve model generalization across different individuals. The combination of these techniques results in an effective and versatile system for sEMG-based hand gesture classification, demonstrating promising performance in adapting individual variability and improving classification accuracy. The proposed method's performance is evaluated and compared with established approaches using the publicity available NinaPro DB5 dataset. Notably, the proposed simple model, coupled with frequency-based attention modules, achieves accuracies of 89.56% with a quick prediction time of 5ms, showcasing its potential for dexterous control of robots and bionic hands. The findings of this research contribute to the advancement of gesture recognition systems, particularly in the domains of human-computer interaction and prosthetic control.
引用
收藏
页码:7835 / 7842
页数:8
相关论文
共 50 条
  • [21] Remote Sensing Image Classification using Transfer Learning and Attention Based Deep Neural Network
    Pham, Lam
    Tran, Khoa
    Ngo, Dat
    Lampert, Jasmin
    Schindler, Alexander
    IMAGE AND SIGNAL PROCESSING FOR REMOTE SENSING XXVIII, 2022, 12267
  • [22] Voice Frequency-Based Gender Classification Using Convolutional Neural Network for Smart Home
    Nasaruddin, Nasaruddin
    Tresma, Muhammad Agung P. Pratama
    Muchamad, Masduki Khamdan
    Fuadi, Zahrul
    IEEE ACCESS, 2024, 12 : 104190 - 104203
  • [23] Enhanced Lightweight CNN Using Joint Classification With Averaging Probability for sEMG-Based Subject-Independent Hand Gesture Recognition
    Leelakittisin, Benjakarn
    Trakulruangroj, Manatsanan
    Sangnark, Soravitt
    Wilaiprasitporn, Theerawit
    Sudhawiyangkul, Thapanun
    IEEE SENSORS JOURNAL, 2023, 23 (17) : 20348 - 20356
  • [24] Surface EMG-Based Instantaneous Hand Gesture Recognition Using Convolutional Neural Network with the Transfer Learning Method
    Yu, Zhipeng
    Zhao, Jianghai
    Wang, Yucheng
    He, Linglong
    Wang, Shaonan
    SENSORS, 2021, 21 (07)
  • [25] A neural network based on SPD manifold learning for skeleton-based hand gesture recognition
    Nguyen, Xuan Son
    Brun, Luc
    Lezoray, Olivier
    Bougleux, Sebastien
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 12028 - 12037
  • [26] Myoelectric Control of a Biomimetic Robotic Hand Using Deep Learning Artificial Neural Network for Gesture Classification
    Kashizadeh, Afsaneh
    Penan, Klyde
    Belford, Andrew
    Razmjou, Amir
    Asadnia, Mohsen
    IEEE SENSORS JOURNAL, 2022, 22 (19) : 18914 - 18921
  • [27] Frequency-based multilayer neural network with on-chip learning and enhanced neuron characterisitcs
    Hikawa, H
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 1999, 10 (03): : 545 - 553
  • [28] Dynamic Hand Gesture Recognition Using Effective Feature Extraction and Attention Based Deep Neural Network
    Miah, Abu Saleh Musa
    Shin, Jungpil
    Hasan, Md. Al Mehedi
    Okuyama, Yuichi
    Nobuyoshi, Asai
    2023 IEEE 16TH INTERNATIONAL SYMPOSIUM ON EMBEDDED MULTICORE/MANY-CORE SYSTEMS-ON-CHIP, MCSOC, 2023, : 241 - 247
  • [29] Convolution Neural Network based Transfer Learning for Classification of Flowers
    Wu, Yong
    Qin, Xiao
    Pan, Yonghua
    Yuan, Changan
    2018 IEEE 3RD INTERNATIONAL CONFERENCE ON SIGNAL AND IMAGE PROCESSING (ICSIP), 2018, : 562 - 566
  • [30] Image Classification Based on transfer Learning of Convolutional neural network
    Wang, Yunyan
    Wang, Chongyang
    Luo, Lengkun
    Zhou, Zhigang
    PROCEEDINGS OF THE 38TH CHINESE CONTROL CONFERENCE (CCC), 2019, : 7506 - 7510