Multi-level Taxonomy Review for Sign Language Recognition: Emphasis on Indian Sign Language

被引:5
|
作者
Bahia, Nimratveer Kaur [1 ]
Rani, Rajneesh [1 ]
机构
[1] Natl Inst Technol, Jalandhar, India
关键词
Indian sign language (ISL); sign language recognition (SLR); vision-based; feature extraction; support vector machine (SVM); region of interest (ROI); FACIAL EXPRESSION RECOGNITION; HAND GESTURE RECOGNITION; FEATURE-EXTRACTION; WORD RECOGNITION; SENSORY GLOVE; NETWORKS; SYSTEMS; SPEECH;
D O I
10.1145/3530259
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the phenomenal increase in image and video databases, there is an increase in the human-computer interaction that recognizes Sign Language. Exchanging information using different gestures between two people is sign language, known as non-verbal communication. Sign language recognition is already done in various languages; however, for Indian Sign Language, there is no adequate amount of work done. This article presents a review on sign language recognition for multiple languages. Data acquisition methods have been over-viewed in four ways (a) Glove-based, (b) Kinect-based, (c) Leap motion controller, and (d) Vision-based. Some of them have pros and cons that have also been discussed for every data acquisition method. Applications of sign language recognition are also discussed. Furthermore, this review also creates a coherent taxonomy to represent the modern research divided into three levels: Level 1 Elementary level (Recognition of sign characters), Level 2 Advanced level (Recognition of sign words), and Level 3 Professional level (Sentence interpretation). The available challenges and issues for each level are also explored in this research to provide valuable perceptions into technological environments. Various publicly available datasets for different sign languages are also discussed. An efficient review of this article shows that the significant exploration of communication via sign acknowledgment has been performed on static, dynamic, isolated, and continuous gestures using various acquisition methods. Comprehensively, the hope is that this study will enable readers to learn new pathways and gain knowledge to carry out further research work in the domain related to sign language recognition.
引用
收藏
页数:39
相关论文
共 50 条
  • [41] Australian sign language recognition
    Holden, EJ
    Lee, G
    Owens, R
    MACHINE VISION AND APPLICATIONS, 2005, 16 (05) : 312 - 320
  • [42] Australian sign language recognition
    Eun-Jung Holden
    Gareth Lee
    Robyn Owens
    Machine Vision and Applications, 2005, 16 : 312 - 320
  • [43] Indian sign language recognition using wearable sensors and multi-label classification
    Gupta, Rinki
    Kumar, Arun
    COMPUTERS & ELECTRICAL ENGINEERING, 2021, 90
  • [44] INCLUDE: A Large Scale Dataset for Indian Sign Language Recognition
    Sridhar, Advaith
    Ganesan, Rohith Gandhi
    Kumar, Pratyush
    Khapra, Mitesh
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 1366 - 1375
  • [45] Hand Gesture Recognition Software Based on Indian Sign Language
    Kadam, Sanket
    Ghodke, Aakash
    Sadhukhan, Sumitra
    PROCEEDINGS OF 2019 1ST INTERNATIONAL CONFERENCE ON INNOVATIONS IN INFORMATION AND COMMUNICATION TECHNOLOGY (ICIICT 2019), 2019,
  • [46] Indian Sign Language Recognition Using Optimized Neural Networks
    Hore, Sirshendu
    Chatterjee, Sankhadeep
    Santhi, V.
    Dey, Nilanjan
    Ashour, Amira S.
    Balas, Valentina Emilia
    Shi, Fuqian
    INFORMATION TECHNOLOGY AND INTELLIGENT TRANSPORTATION SYSTEMS, VOL 2, 2017, 455 : 553 - 563
  • [47] Indian Sign Language Recognition Using ANN And SVM Classifiers
    Ekbote, Juhi
    Joshi, Mahasweta
    2017 INTERNATIONAL CONFERENCE ON INNOVATIONS IN INFORMATION, EMBEDDED AND COMMUNICATION SYSTEMS (ICIIECS), 2017,
  • [48] Real-time Indian Sign Language (ISL) Recognition
    Shenoy, Kartik
    Dastane, Tejas
    Rao, Varun
    Vyavaharkar, Devendra
    2018 9TH INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION AND NETWORKING TECHNOLOGIES (ICCCNT), 2018,
  • [49] Indian Sign Language Translator Using Gesture Recognition Algorithm
    Badhe, Purva C.
    Kulkarni, Vaishali
    2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER GRAPHICS, VISION AND INFORMATION SECURITY (CGVIS), 2015, : 195 - 200
  • [50] Design and Recording of Czech Sign Language Corpus for Automatic Sign Language Recognition
    Campr, Pavel
    Hruz, Marek
    Zelezny, Milos
    INTERSPEECH 2007: 8TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION, VOLS 1-4, 2007, : 2213 - 2216