Recurrent Neural Networks and Machine Learning Models Applied in Sign Language Recognition

被引:0
|
作者
Novillo Quinde, Esteban Gustavo [1 ]
Saldana Torres, Juan Pablo [1 ]
Alvarez Valdez, Michael Andres [1 ]
Llivicota Leon, John Santiago [1 ]
Hurtado Ortiz, Remigio Ismael [1 ]
机构
[1] Univ Politecn Salesiana, Cuenca, Ecuador
关键词
Data science; Machine learning; Sign language; Random forest; RNN; RF with DataAugm; RNN with DataAugm; Voting;
D O I
10.1007/978-981-97-3559-4_49
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This research is dedicated to promoting the inclusion of individuals with hearing disabilities, addressing their unique communication needs through the development of a sign language translation system. Efficiently predicting the gestures of non-hearing individuals is essential for breaking barriers and facilitating smooth communication in their daily lives. To achieve this goal, we propose a three-phase method that involves data preparation and cleaning. For modeling, we leverage cutting-edge techniques, including random forest with data augmentation, recurrent neural networks (RNNs), and a voting system to combine the best-performing models. Our approach is centered on the 'Australian Sign Language signs' dataset, which offers a valuable resource for sign language recognition. By incorporating these advanced methods, we strive to achieve unparalleled accuracy, precision, recall, and F1-score in predicting signs within the Australian sign language using this dataset. Moreover, our work sets the foundation for future research, encouraging the exploration of advanced supervised modeling techniques to further elevate the obtained results. We envision that the integration of RNN, random forest with data augmentation, and the voting system will enable us to break new ground in sign language translation, empowering individuals with hearing disabilities to engage fully in their personal and professional endeavors with improved accessibility and inclusivity.
引用
收藏
页码:615 / 624
页数:10
相关论文
共 50 条
  • [21] Natural language grammatical inference: A comparison of recurrent neural networks and machine learning methods
    Lawrence, S.
    Fong, S.
    Giles, C.L.
    Lecture Notes in Artificial Intelligence (Subseries of Lecture Notes in Computer Science), 1996, 1040
  • [22] Indian Sign Language Recognition Using Machine Learning Techniques
    Sahoo, Ashok Kumar
    MACROMOLECULAR SYMPOSIA, 2021, 397 (01)
  • [23] Arabic Sign Language Recognition Using Deep Machine Learning
    Suliman, Wael
    Deriche, Mohamed
    Luqman, Hamzah
    Mohandes, Mohamed
    2021 4TH INTERNATIONAL SYMPOSIUM ON ADVANCED ELECTRICAL AND COMMUNICATION TECHNOLOGIES (ISAECT), 2021,
  • [24] A Review of Machine Learning-Based Recognition of Sign Language
    Singh, Shaminder
    Gupta, Anuj Kumar
    Arora, Tanvi
    INTERNATIONAL JOURNAL OF IMAGE AND GRAPHICS, 2023, 23 (06)
  • [25] Learning Device Models with Recurrent Neural Networks
    Clemens, John
    2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018,
  • [26] An Applied Holistic Landmark with Deep Learning for Thai Sign Language Recognition
    Chaikaew, Anusorn
    2022 37TH INTERNATIONAL TECHNICAL CONFERENCE ON CIRCUITS/SYSTEMS, COMPUTERS AND COMMUNICATIONS (ITC-CSCC 2022), 2022, : 1046 - 1049
  • [27] Sign Language Recognition: A Comparative Analysis of Deep Learning Models
    Premkumar, Aswathi
    Krishna, R. Hridya
    Chanalya, Nikita
    Meghadev, C.
    Varma, Utkrist Arvind
    Anjali, T.
    Rani, S. Siji
    INVENTIVE COMPUTATION AND INFORMATION TECHNOLOGIES, ICICIT 2021, 2022, 336 : 1 - 13
  • [28] Arabic Sign Language Recognition Using Deep Learning Models
    Al-Barham, Muhammad
    Abu Sa'aleek, Ahmad
    Al-Odat, Mohammad
    Hamad, Ghada
    Al-Yaman, Musa
    Elnagar, Ashraf
    2022 13TH INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION SYSTEMS (ICICS), 2022, : 226 - 231
  • [29] Improving Recurrent Neural Networks for Offline Arabic Handwriting Recognition by Combining Different Language Models
    Jemni, Sana Khamekhem
    Kessentini, Yousri
    Kanoun, Slim
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2020, 34 (12)
  • [30] ESMAANI: A Static and Dynamic Arabic Sign Language Recognition System Based on Machine and Deep Learning Models
    Hisham, Essam
    Saleh, Sherine Nagy
    2022 5TH INTERNATIONAL CONFERENCE ON COMMUNICATIONS, SIGNAL PROCESSING, AND THEIR APPLICATIONS (ICCSPA), 2022,