A Frequency-Based Attention Neural Network and Subject-Adaptive Transfer Learning for sEMG Hand Gesture Classification

被引:2
|
作者
Nguyen, Phuc Thanh-Thien [1 ]
Su, Shun-Feng [1 ]
Kuo, Chung-Hsien [2 ]
机构
[1] Natl Taiwan Univ Sci & Technol, Dept Elect Taipei, Taipei 106, Taiwan
[2] Natl Taiwan Univ, Dept Mech Engn, Taipei 106, Taiwan
来源
关键词
Feature extraction; Transfer learning; Transforms; Gesture recognition; Neural networks; Muscles; Fast Fourier transforms; Frequency-based attention; fourier transform; short-time fourier transform; class-imbalanced classification; surface electromyography (sEMG);
D O I
10.1109/LRA.2024.3433748
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
This study introduces a novel approach for real-time hand gesture classification through the integration of a Frequency-based Attention Neural Network (FANN) with Subject-Adaptive Transfer Learning, specifically tailored for surface electromyography (sEMG) data. By utilizing the Fourier transform, the proposed methodology leverages the inherent frequency characteristics of sEMG signals to enhance the discriminative features for accurate gesture recognition. Additionally, the subject-adaptive transfer learning strategy is employed to improve model generalization across different individuals. The combination of these techniques results in an effective and versatile system for sEMG-based hand gesture classification, demonstrating promising performance in adapting individual variability and improving classification accuracy. The proposed method's performance is evaluated and compared with established approaches using the publicity available NinaPro DB5 dataset. Notably, the proposed simple model, coupled with frequency-based attention modules, achieves accuracies of 89.56% with a quick prediction time of 5ms, showcasing its potential for dexterous control of robots and bionic hands. The findings of this research contribute to the advancement of gesture recognition systems, particularly in the domains of human-computer interaction and prosthetic control.
引用
收藏
页码:7835 / 7842
页数:8
相关论文
共 50 条
  • [1] Deep Learning with Attention on Hand Gesture Recognition Based on sEMG
    Zhao, Huanjun
    Zheng, Bin
    Wang, Le
    2022 PROGNOSTICS AND HEALTH MANAGEMENT CONFERENCE, PHM-LONDON 2022, 2022, : 316 - 320
  • [2] Transfer Learning Enhanced Cross-Subject Hand Gesture Recognition with sEMG
    Zhang, Shenyilang
    Fang, Yinfeng
    Wan, Jiacheng
    Jiang, Guozhang
    Li, Gongfa
    JOURNAL OF MEDICAL AND BIOLOGICAL ENGINEERING, 2023, 43 (06) : 672 - 688
  • [3] Transfer Learning Enhanced Cross-Subject Hand Gesture Recognition with sEMG
    Shenyilang Zhang
    Yinfeng Fang
    Jiacheng Wan
    Guozhang Jiang
    Gongfa Li
    Journal of Medical and Biological Engineering, 2023, 43 : 672 - 688
  • [4] Hand Gesture Recognition Based on sEMG Signal and Convolutional Neural Network
    Su, Ziyi
    Liu, Handong
    Qian, Jinwu
    Zhang, Zhen
    Zhang, Lunwei
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2021, 35 (11)
  • [5] sEMG-Based Hand Gesture Recognition Using Binarized Neural Network
    Kang, Soongyu
    Kim, Haechan
    Park, Chaewoon
    Sim, Yunseong
    Lee, Seongjoo
    Jung, Yunho
    SENSORS, 2023, 23 (03)
  • [6] Subject Independent Classification of Hand Gesture from sEMG using an Approximate Entropy Based Approach
    Paul, Joydip
    Alam, Mohammad Tahmidul
    Paul, Sudip
    PROCEEDINGS OF 2020 11TH INTERNATIONAL CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING (ICECE), 2020, : 238 - 241
  • [7] SEMG based classification of hand gestures using artificial neural network
    Emayavaramban, G.
    Divyapriya, S.
    Mansoor, V. M.
    Amudha, A.
    Ramkumar, M. Siva
    Nagaveni, P.
    SivaramKrishnan, M.
    MATERIALS TODAY-PROCEEDINGS, 2021, 37 : 2591 - 2598
  • [8] Transfer Learning-Based Convolution Neural Network Model for Hand Gesture Recognition
    Kumari, Niranjali
    Joshi, Garima
    Kaur, Satwinder
    Vig, Renu
    THIRD CONGRESS ON INTELLIGENT SYSTEMS, CIS 2022, VOL 1, 2023, 608 : 827 - 840
  • [9] Hand gesture classification using time-frequency images and transfer learning based on CNN
    Ozdemir, Mehmet Akif
    Kisa, Deniz Hande
    Guren, Onan
    Akan, Aydin
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2022, 77
  • [10] Frequency-based multilayer neural network with on-chip learning
    Hikawa, H
    ISCAS 96: 1996 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS - CIRCUITS AND SYSTEMS CONNECTING THE WORLD, VOL 3, 1996, : 469 - 472