Recurrent Neural Networks and Machine Learning Models Applied in Sign Language Recognition

被引:0
|
作者
Novillo Quinde, Esteban Gustavo [1 ]
Saldana Torres, Juan Pablo [1 ]
Alvarez Valdez, Michael Andres [1 ]
Llivicota Leon, John Santiago [1 ]
Hurtado Ortiz, Remigio Ismael [1 ]
机构
[1] Univ Politecn Salesiana, Cuenca, Ecuador
关键词
Data science; Machine learning; Sign language; Random forest; RNN; RF with DataAugm; RNN with DataAugm; Voting;
D O I
10.1007/978-981-97-3559-4_49
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This research is dedicated to promoting the inclusion of individuals with hearing disabilities, addressing their unique communication needs through the development of a sign language translation system. Efficiently predicting the gestures of non-hearing individuals is essential for breaking barriers and facilitating smooth communication in their daily lives. To achieve this goal, we propose a three-phase method that involves data preparation and cleaning. For modeling, we leverage cutting-edge techniques, including random forest with data augmentation, recurrent neural networks (RNNs), and a voting system to combine the best-performing models. Our approach is centered on the 'Australian Sign Language signs' dataset, which offers a valuable resource for sign language recognition. By incorporating these advanced methods, we strive to achieve unparalleled accuracy, precision, recall, and F1-score in predicting signs within the Australian sign language using this dataset. Moreover, our work sets the foundation for future research, encouraging the exploration of advanced supervised modeling techniques to further elevate the obtained results. We envision that the integration of RNN, random forest with data augmentation, and the voting system will enable us to break new ground in sign language translation, empowering individuals with hearing disabilities to engage fully in their personal and professional endeavors with improved accessibility and inclusivity.
引用
收藏
页码:615 / 624
页数:10
相关论文
共 50 条
  • [31] Sign Language Recognition with Recurrent Neural Network using Human Keypoint Detection
    Ko, Sang-Ki
    Son, Jae Gi
    Jung, Hyedong
    PROCEEDINGS OF THE 2018 CONFERENCE ON RESEARCH IN ADAPTIVE AND CONVERGENT SYSTEMS (RACS 2018), 2018, : 326 - 328
  • [32] American Sign Language Character Recognition using Convolutional Neural Networks
    Abdullah, Atesam
    Ali, Nisar
    Ali, Raja Hashim
    Ul Abideen, Zain
    Ijaz, Ali Zeeshan
    Bais, Abdul
    2023 IEEE CANADIAN CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING, CCECE, 2023,
  • [33] ASLR: Arabic Sign Language Recognition Using Convolutional Neural Networks
    Althagafi, Asma
    Althobaiti, Ghofran
    Alsubait, Tahani
    Alqurashi, Tahani
    INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2020, 20 (07): : 124 - 129
  • [34] Recognition of vowels letters of Turkish sign language by artificial neural networks
    Selda, Bayrak
    Vasif, Nabiyev V.
    2006 IEEE 14TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS, VOLS 1 AND 2, 2006, : 125 - +
  • [35] Recognition of Urdu sign language: a systematic review of the machine learning classification
    Zahid, Hira
    Rashid, Munaf
    Hussain, Samreen
    Azim, Fahad
    Syed, Sidra Abid
    Saad, Afshan
    PEERJ COMPUTER SCIENCE, 2022, 8
  • [36] Machine learning methods for sign language recognition: A critical review and analysis
    Adeyanju, I. A.
    Bello, O. O.
    Adegboye, M. A.
    INTELLIGENT SYSTEMS WITH APPLICATIONS, 2021, 12
  • [37] Recognition of Urdu sign language: a systematic review of the machine learning classification
    Zahid H.
    Rashid M.
    Hussain S.
    Azim F.
    Syed S.A.
    Saad A.
    PeerJ Computer Science, 2022, 8
  • [38] Fingerspelling Recognition in Mexican Sign Language (LSM) Using Machine Learning
    Fernando Morfin-Chavez, Ricardo
    Javier Gortarez-Pelayo, Jesus
    Hussein Lopez-Nava, Irvin
    ADVANCES IN COMPUTATIONAL INTELLIGENCE, MICAI 2023, PT I, 2024, 14391 : 110 - 120
  • [39] Extreme Learning Machine for Real Time Recognition of Brazilian Sign Language
    de Paula Neto, Fernando M.
    Cambuim, Lucas F.
    Macieira, Rafael M.
    Ludermir, Teresa B.
    Zanchettin, Cleber
    Barros, Edna N.
    2015 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC 2015): BIG DATA ANALYTICS FOR HUMAN-CENTRIC SYSTEMS, 2015, : 1464 - 1469
  • [40] A Machine Learning Based Approach for the Detection and Recognition of Bangla Sign Language
    Hasan, Muttaki
    Sajib, Tanvir Hossain
    Dey, Mrinmoy
    2016 INTERNATIONAL CONFERENCE ON MEDICAL ENGINEERING, HEALTH INFORMATICS AND TECHNOLOGY (MEDITEC), 2016,