Romanian Sign Language and Mime-Gesture Recognition

被引:0
|
作者
Andrei, Enachi [1 ,2 ]
Cornel, Turcu [1 ]
Culea, George [2 ]
Constantin, Sghera Bogdan [1 ,2 ]
Gabriel, Ungureanu Andrei [1 ,2 ]
机构
[1] Stefan Cel Mare Univ Suceava, Fac Elect Engn & Comp Sci, Suceava, Romania
[2] Vasile Alecsandri Univ Bacau, Dept Energet & Comp Sci, Bacau, Romania
关键词
RSL; sign language; machine learning; model; mime gestures;
D O I
10.14569/IJACSA.2024.0150888
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
paper presents a comprehensive approach to Romanian Sign Language (RSL) recognition using machine learning techniques. The primary focus is on developing and evaluating a robust model capable of accurately classifying hand and mime gestures representative of RSL and converting it into speech through an application. Utilizing a dataset of hand landmarks captured and stored in CSV format, the study outlines the preprocessing steps, model training, and performance evaluation. Key components of the methodology include data preparation, model training, performance evaluation and model optimization. The results demonstrate the feasibility of using machine learning for RSL recognition, achieving promising accuracy rates. The study concludes with a discussion on potential applications and future enhancements, including real-time gesture recognition and expanding the dataset for improved generalization. This work contributes to the broader effort of making sign language more accessible through technology, particularly for the Romanian-speaking deaf and hard-of-hearing community.
引用
收藏
页码:895 / 902
页数:8
相关论文
共 50 条
  • [41] Gesture Recognition of Sign Language Alphabet Using a Magnetic Positioning System
    Rinalduzzi, Matteo
    De Angelis, Alessio
    Santoni, Francesco
    Buchicchio, Emanuele
    Moschitta, Antonio
    Carbone, Paolo
    Bellitti, Paolo
    Serpelloni, Mauro
    APPLIED SCIENCES-BASEL, 2021, 11 (12):
  • [42] Possibility Theory Based Continuous Indian Sign Language Gesture Recognition
    Baranwal, Neha
    Tripathi, Kumud
    Nandi, G. C.
    TENCON 2015 - 2015 IEEE REGION 10 CONFERENCE, 2015,
  • [43] Gesture Recognition for Fingerspelling Applications: An Approach Based on Sign Language Cheremes
    Madeo, Renata C. B.
    Peres, Sarajane M.
    Dias, Daniel B.
    Boscarioli, Clodis
    ASSETS 2010: PROCEEDINGS OF THE 12TH INTERNATIONAL ACM SIGACCESS CONFERENCE ON COMPUTERS AND ACCESSIBILITY, 2010, : 261 - 262
  • [44] Inertial Motion Sensing Glove for Sign Language Gesture Acquisition and Recognition
    Galka, Jakub
    Masior, Mariusz
    Zaborski, Mateusz
    Barczewska, Katarzyna
    IEEE SENSORS JOURNAL, 2016, 16 (16) : 6310 - 6316
  • [45] Development and validation of a Brazilian sign language database for human gesture recognition
    Rezende, Tamires Martins
    Moreira Almeida, Silvia Grasiella
    Guimaraes, Frederico Gadelha
    NEURAL COMPUTING & APPLICATIONS, 2021, 33 (16): : 10449 - 10467
  • [46] Developing Automatic Markerless Sign Language Gesture Tracking and Recognition System
    Demidenko, S.
    Ooi, M.
    Akmeliawati, R.
    Gupta, G. Sen
    Kuang, Y. C.
    Bailey, D.
    Khan, S.
    Gamage, N.
    Bilal, S.
    2019 IEEE INTERNATIONAL SYMPOSIUM ON HAPTIC AUDIO-VISUAL ENVIRONMENTS & GAMES (HAVE 2019), 2019,
  • [47] Reduction of Gesture Feature Dimension for Improving the Hand Gesture Recognition Performance of Numerical Sign Language
    Bhuiyan, Rasel Ahmed
    Tushar, Abdul Kawsar
    Ashiquzzainani, Akm
    Shin, Jungian
    Islam, Md Rashedul
    2017 20TH INTERNATIONAL CONFERENCE OF COMPUTER AND INFORMATION TECHNOLOGY (ICCIT), 2017,
  • [48] Continuous Dynamic Indian Sign Language Gesture Recognition with Invariant Backgrounds
    Tripathi, Kumud
    Baranwal, Neha
    Nandi, G. C.
    2015 INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING, COMMUNICATIONS AND INFORMATICS (ICACCI), 2015, : 2211 - 2216
  • [49] C-Libras: A Gesture Recognition App for the Brazilian Sign Language
    Trotta, Tiago
    Rocha, Leonardo
    de Andrade, Telma Rosa
    Guimaraes, Marcelo de Paiva
    Colombo Dias, Diego Roberto
    COMPUTATIONAL SCIENCE AND ITS APPLICATIONS, ICCSA 2022, PT I, 2022, 13375 : 603 - 618
  • [50] Development and validation of a Brazilian sign language database for human gesture recognition
    Tamires Martins Rezende
    Sílvia Grasiella Moreira Almeida
    Frederico Gadelha Guimarães
    Neural Computing and Applications, 2021, 33 : 10449 - 10467