Sign language finger alphabet recognition from Gabor-PCA representation of hand gestures

被引:0
|
作者
Amin, M. Ashraful [1 ]
Yan, Hong [1 ]
机构
[1] City Univ Hong Kong, Dept Elect Engn, Hong Kong, Hong Kong, Peoples R China
关键词
sign language; finger alphabet recognition; Gabor wavelets; PCA; clustering algorithm;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
During recent years a large number of computer aided applications have been developed to help the disabled people. This has improved the communication between the able and the hearing impaired community. An intelligent signed alphabet recognizer can work as an aiding agent to translate the signs to words (and also sentences) and vice versa. To achieve this goal few steps to be followed, among which the first complicated task is to recognize the sign-language alphabets from hand gesture images. In this paper, we propose a system that is able to recognize American Sign Language (ASL) alphabets from hand gesture with average 93.23% accuracy. The classification is performed with fuzzy-c-mean clustering an a lower dimensional data which is acquired from the Principle Component Analysis (PCA) of Gabor representation of hand gesture images. Out of the top 20 Principle Components (PCs) the best combination of PCs is determined by finding the best fuzzy cluster for the corresponding PCs of the training data. The best result is obtained from the combination of the fourth to seventh principle components.
引用
收藏
页码:2218 / 2223
页数:6
相关论文
共 50 条
  • [41] Static Gestures Recognition for Brazilian Sign Language with Kinect Sensor
    Carneiro, Sergio Bessa
    Santos, Edson D. F. de M.
    Barbosa, Talles M. de A.
    Ferreira, Jose O.
    Soares Alcala, Symone G.
    Da Rocha, Adson F.
    2016 IEEE SENSORS, 2016,
  • [42] Recognition of Static Gestures applied to Brazilian Sign Language (Libras)
    Bastos, Igor L. O.
    Angelo, Michele F.
    Loula, Angelo C.
    2015 28TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES, 2015, : 305 - 312
  • [43] Recognition of Gestures in Pakistani Sign Language using Fuzzy Classifier
    Kausar, Sumaira
    Javed, M. Younus
    Sohail, Shaleeza
    ISCGAV'08: PROCEEDINGS OF THE 8TH WSEAS INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING, COMPUTATIONAL GEOMETRY AND ARTIFICIAL VISION, 2008, : 101 - 105
  • [44] Sign language phoneme transcription with PCA-based representation
    Kong, W. W.
    Ranganath, Surendra
    2007 6TH INTERNATIONAL CONFERENCE ON INFORMATION, COMMUNICATIONS & SIGNAL PROCESSING, VOLS 1-4, 2007, : 542 - 546
  • [45] Real-time recognition of hand alphabet gestures using principal component analysis
    Birk, H
    Moeslund, TB
    Madsen, CB
    SCIA '97 - PROCEEDINGS OF THE 10TH SCANDINAVIAN CONFERENCE ON IMAGE ANALYSIS, VOLS 1 AND 2, 1997, : 261 - 268
  • [46] American Sign Language finger spelling recognition system
    Allen, JM
    Asselin, PK
    Foulds, R
    PROCEEDINGS OF THE IEEE 29TH ANNUAL NORTHEAST BIOENGINEERING CONFERENCE, 2003, : 285 - 286
  • [47] The design of hand gestures for human-computer interaction: Lessons from sign language interpreters
    Rempel, David
    Camilleri, Matt J.
    Lee, David L.
    INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES, 2014, 72 (10-11) : 728 - 735
  • [48] Hand gestures for emergency situations: A video dataset based on words from Indian sign language
    Adithya, V.
    Rajesh, R.
    DATA IN BRIEF, 2020, 31
  • [49] A Survey of Hand Gesture Recognition Methods in Sign Language Recognition
    Suharjito
    Ariesta, Meita Chandra
    Wiryana, Fanny
    Kusuma, Gede Putra
    PERTANIKA JOURNAL OF SCIENCE AND TECHNOLOGY, 2018, 26 (04): : 1659 - 1675
  • [50] SignBERT: Pre-Training of Hand-Model-Aware Representation for Sign Language Recognition
    Hu, Hezhen
    Zhao, Weichao
    Zhou, Wengang
    Wang, Yuechen
    Li, Houqiang
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 11067 - 11076