Sign language finger alphabet recognition from Gabor-PCA representation of hand gestures

被引:0
|
作者
Amin, M. Ashraful [1 ]
Yan, Hong [1 ]
机构
[1] City Univ Hong Kong, Dept Elect Engn, Hong Kong, Hong Kong, Peoples R China
关键词
sign language; finger alphabet recognition; Gabor wavelets; PCA; clustering algorithm;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
During recent years a large number of computer aided applications have been developed to help the disabled people. This has improved the communication between the able and the hearing impaired community. An intelligent signed alphabet recognizer can work as an aiding agent to translate the signs to words (and also sentences) and vice versa. To achieve this goal few steps to be followed, among which the first complicated task is to recognize the sign-language alphabets from hand gesture images. In this paper, we propose a system that is able to recognize American Sign Language (ASL) alphabets from hand gesture with average 93.23% accuracy. The classification is performed with fuzzy-c-mean clustering an a lower dimensional data which is acquired from the Principle Component Analysis (PCA) of Gabor representation of hand gesture images. Out of the top 20 Principle Components (PCs) the best combination of PCs is determined by finding the best fuzzy cluster for the corresponding PCs of the training data. The best result is obtained from the combination of the fourth to seventh principle components.
引用
收藏
页码:2218 / 2223
页数:6
相关论文
共 50 条
  • [31] Exploiting Recurrent Neural Networks and Leap Motion Controller for the Recognition of Sign Language and Semaphoric Hand Gestures
    Avola, Danilo
    Bernardi, Marco
    Cinque, Luigi
    Foresti, Gian Luca
    Massaroni, Cristiano
    IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (01) : 234 - 245
  • [32] Recognition of Arabic sign language alphabet using polynomial classifiers
    Assaleh, K
    Al-Rousan, M
    EURASIP JOURNAL ON APPLIED SIGNAL PROCESSING, 2005, 2005 (13) : 2136 - 2145
  • [33] American Sign Language Alphabet Recognition Using Microsoft Kinect
    Dong, Cao
    Leu, Ming C.
    Yin, Zhaozheng
    2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2015,
  • [34] Recognition of Arabic Sign Language Alphabet Using Polynomial Classifiers
    Khaled Assaleh
    M. Al-Rousan
    EURASIP Journal on Advances in Signal Processing, 2005
  • [35] Interactive and Markerless Visual Recognition of Brazilian Sign Language Alphabet
    Furtado, Silas Luiz
    de Oliveira, Jauvane C.
    Shirmohammadi, Shervin
    2023 IEEE INTERNATIONAL INSTRUMENTATION AND MEASUREMENT TECHNOLOGY CONFERENCE, I2MTC, 2023,
  • [36] Recognition of arabic sign language alphabet using polynomial classifiers
    Assaleh, K. (kassaleh@ausharjah.edu), 1600, Hindawi Publishing Corporation (2005):
  • [37] Joint space representation and recognition of sign language fingerspelling using Gabor filter and convolutional neural network
    Hamzah Luqman
    El-Sayed M. El-Alfy
    Galal M. BinMakhashen
    Multimedia Tools and Applications, 2021, 80 : 10213 - 10234
  • [38] Joint space representation and recognition of sign language fingerspelling using Gabor filter and convolutional neural network
    Luqman, Hamzah
    El-Alfy, El-Sayed M.
    BinMakhashen, Galal M.
    MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (07) : 10213 - 10234
  • [39] Real Time Sign Language Recognition using PCA
    Sawant, Shreyashi Narayan
    Kumbhar, M. S.
    2014 INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATION CONTROL AND COMPUTING TECHNOLOGIES (ICACCCT), 2014, : 1412 - 1415
  • [40] Spatiotemporal Pyramid Representation for Recognition of Facial Expressions and Hand Gestures
    Zhao, Zhipeng
    Elgammal, Ahmed
    2008 8TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE & GESTURE RECOGNITION (FG 2008), VOLS 1 AND 2, 2008, : 355 - 360