Recurrent Neural Networks and Machine Learning Models Applied in Sign Language Recognition

被引:0
|
作者
Novillo Quinde, Esteban Gustavo [1 ]
Saldana Torres, Juan Pablo [1 ]
Alvarez Valdez, Michael Andres [1 ]
Llivicota Leon, John Santiago [1 ]
Hurtado Ortiz, Remigio Ismael [1 ]
机构
[1] Univ Politecn Salesiana, Cuenca, Ecuador
关键词
Data science; Machine learning; Sign language; Random forest; RNN; RF with DataAugm; RNN with DataAugm; Voting;
D O I
10.1007/978-981-97-3559-4_49
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This research is dedicated to promoting the inclusion of individuals with hearing disabilities, addressing their unique communication needs through the development of a sign language translation system. Efficiently predicting the gestures of non-hearing individuals is essential for breaking barriers and facilitating smooth communication in their daily lives. To achieve this goal, we propose a three-phase method that involves data preparation and cleaning. For modeling, we leverage cutting-edge techniques, including random forest with data augmentation, recurrent neural networks (RNNs), and a voting system to combine the best-performing models. Our approach is centered on the 'Australian Sign Language signs' dataset, which offers a valuable resource for sign language recognition. By incorporating these advanced methods, we strive to achieve unparalleled accuracy, precision, recall, and F1-score in predicting signs within the Australian sign language using this dataset. Moreover, our work sets the foundation for future research, encouraging the exploration of advanced supervised modeling techniques to further elevate the obtained results. We envision that the integration of RNN, random forest with data augmentation, and the voting system will enable us to break new ground in sign language translation, empowering individuals with hearing disabilities to engage fully in their personal and professional endeavors with improved accessibility and inclusivity.
引用
收藏
页码:615 / 624
页数:10
相关论文
共 50 条
  • [1] Machine Learning Models Applied in Sign Language Recognition
    Novillo Quinde, Esteban Gustavo
    Saldana Torres, Juan Pablo
    Alvarez Valdez, Michael Andres
    Llivicota Leon, John Santiago
    Hurtado Ortiz, Remigio Ismael
    PATTERN RECOGNITION, MCPR 2023, 2023, 13902 : 263 - 272
  • [2] Peruvian Sign Language Recognition Using Recurrent Neural Networks
    Barrientos-Villalta, Geraldine Fiorella
    Quiroz, Piero
    Ugarte, Willy
    ADVANCED RESEARCH IN TECHNOLOGIES, INFORMATION, INNOVATION AND SUSTAINABILITY, ARTIIS 2022, PT I, 2022, 1675 : 459 - 473
  • [3] Recognition of Arabic Sign Language (ArSL) Using Recurrent Neural Networks
    Maraqa, Manar
    Abu-Zaiter, Raed
    2008 FIRST INTERNATIONAL CONFERENCE ON THE APPLICATIONS OF DIGITAL INFORMATION AND WEB TECHNOLOGIES, VOLS 1 AND 2, 2008, : 485 - +
  • [4] Recurrent Convolutional Neural Networks for Continuous Sign Language Recognition by Staged Optimization
    Cui, Runpeng
    Liu, Hu
    Zhang, Changshui
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 1610 - 1618
  • [5] Sign Language Recognition using Neural Networks
    Dogic, Sabaheta
    Karli, Gunay
    TEM JOURNAL-TECHNOLOGY EDUCATION MANAGEMENT INFORMATICS, 2014, 3 (04): : 296 - 301
  • [6] Sign Language Recognition Using Machine Learning
    Soundarya, M.
    Yazhini, M.
    Sree, Thirumala N. S.
    Sornamalaya, N. M.
    Vinitha, C.
    2024 INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING, COMMUNICATION AND APPLIED INFORMATICS, ACCAI 2024, 2024,
  • [7] Automatic Recognition of Mexican Sign Language Using a Depth Camera and Recurrent Neural Networks
    Mejia-Perez, Kenneth
    Cordova-Esparza, Diana-Margarita
    Terven, Juan
    Herrera-Navarro, Ana-Marcela
    Garcia-Ramirez, Teresa
    Ramirez-Pedraza, Alfonso
    APPLIED SCIENCES-BASEL, 2022, 12 (11):
  • [8] SIGN LANGUAGE DETECTION "IN THE WILD" WITH RECURRENT NEURAL NETWORKS
    Borg, Mark
    Camilleri, Kenneth P.
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 1637 - 1641
  • [9] Optimized Hybrid Convolution Neural Network with Machine Learning for Arabic Sign Language Recognition
    Mahmoud, Ahmed Osman
    Ziedan, Aibrahim
    Zamel, Amr A.
    TRAITEMENT DU SIGNAL, 2024, 41 (04) : 1835 - 1846
  • [10] Sign Language Recognition Using Convolutional Neural Networks
    Pigou, Lionel
    Dieleman, Sander
    Kindermans, Pieter-Jan
    Schrauwen, Benjamin
    COMPUTER VISION - ECCV 2014 WORKSHOPS, PT I, 2015, 8925 : 572 - 578