Recurrent Neural Networks and Machine Learning Models Applied in Sign Language Recognition

被引:0
|
作者
Novillo Quinde, Esteban Gustavo [1 ]
Saldana Torres, Juan Pablo [1 ]
Alvarez Valdez, Michael Andres [1 ]
Llivicota Leon, John Santiago [1 ]
Hurtado Ortiz, Remigio Ismael [1 ]
机构
[1] Univ Politecn Salesiana, Cuenca, Ecuador
关键词
Data science; Machine learning; Sign language; Random forest; RNN; RF with DataAugm; RNN with DataAugm; Voting;
D O I
10.1007/978-981-97-3559-4_49
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This research is dedicated to promoting the inclusion of individuals with hearing disabilities, addressing their unique communication needs through the development of a sign language translation system. Efficiently predicting the gestures of non-hearing individuals is essential for breaking barriers and facilitating smooth communication in their daily lives. To achieve this goal, we propose a three-phase method that involves data preparation and cleaning. For modeling, we leverage cutting-edge techniques, including random forest with data augmentation, recurrent neural networks (RNNs), and a voting system to combine the best-performing models. Our approach is centered on the 'Australian Sign Language signs' dataset, which offers a valuable resource for sign language recognition. By incorporating these advanced methods, we strive to achieve unparalleled accuracy, precision, recall, and F1-score in predicting signs within the Australian sign language using this dataset. Moreover, our work sets the foundation for future research, encouraging the exploration of advanced supervised modeling techniques to further elevate the obtained results. We envision that the integration of RNN, random forest with data augmentation, and the voting system will enable us to break new ground in sign language translation, empowering individuals with hearing disabilities to engage fully in their personal and professional endeavors with improved accessibility and inclusivity.
引用
收藏
页码:615 / 624
页数:10
相关论文
共 50 条
  • [41] Deep motion templates and extreme learning machine for sign language recognition
    Imran, Javed
    Raman, Balasubramanian
    VISUAL COMPUTER, 2020, 36 (06): : 1233 - 1246
  • [42] Deep motion templates and extreme learning machine for sign language recognition
    Javed Imran
    Balasubramanian Raman
    The Visual Computer, 2020, 36 : 1233 - 1246
  • [43] Sign language recognition using competitive learning in the HAVNET neural network
    Sujan, VA
    Meggiolaro, MA
    APPLICATIONS OF ARTIFICIAL NEURAL NETWORKS IN IMAGE PROCESSING V, 2000, 3962 : 2 - 12
  • [44] Application of Neural Networks and Machine Learning in Image Recognition
    Gali, Dario
    Stojanovi, Zvezdan
    Caji, Elvir
    TEHNICKI VJESNIK-TECHNICAL GAZETTE, 2024, 31 (01): : 316 - 323
  • [45] A RECURRENT NEURAL NETWORKS APPROACH FOR KEYWORD SPOTTING APPLIED ON ROMANIAN LANGUAGE
    Pipa, Sonia
    Boros, Tiberiu
    PROCEEDINGS OF THE 12TH INTERNATIONAL CONFERENCE 'LINQUISTIC RESOURCES AND TOOLS FOR PROCESSING THE ROMANIAN LANGUAGE', 2016, : 111 - 120
  • [46] Sign Language Recognition with Transformer Networks
    De Coster, Mathieu
    Van Herreweghe, Mieke
    Dambre, Joni
    PROCEEDINGS OF THE 12TH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (LREC 2020), 2020, : 6018 - 6024
  • [47] Scalable Bayesian Learning of Recurrent Neural Networks for Language Modeling
    Gan, Zhe
    Li, Chunyuan
    Chen, Changyou
    Pu, Yunchen
    Su, Qinliang
    Carin, Lawrence
    PROCEEDINGS OF THE 55TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2017), VOL 1, 2017, : 321 - 331
  • [48] Learning of Recurrent Convolutional Neural Networks with Applications in Pattern Recognition
    Wang, Qiaoyun
    Huang, He
    PROCEEDINGS OF THE 36TH CHINESE CONTROL CONFERENCE (CCC 2017), 2017, : 4135 - 4139
  • [49] Investigating Bidirectional Recurrent Neural Network Language Models for Speech Recognition
    Chen, X.
    Ragni, A.
    Liu, X.
    Gales, M. J. F.
    18TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2017), VOLS 1-6: SITUATED INTERACTION, 2017, : 269 - 273
  • [50] Convolutional and recurrent neural network for human activity recognition: Application on American sign language
    Hernandez, Vincent
    Suzuki, Tomoya
    Venture, Gentiane
    PLOS ONE, 2020, 15 (02):