American Sign Language Translation from Deaf-Mute People Based on Novel System

被引：0
|
作者：
Sahm B.A. [1 ]
Al-Fahaam H. [1 ]
Jasim A.A. [2 ]
机构：
[1] Department of Computer Engineering, College of Engineering, University of Basrah, Basra, Al Hartha
[2] College of Oil and Gas Engineering, Basrah University for Oil and Gas, Basra, Al Quma
来源：
Journal of Engineering and Technological Sciences | 2024年 / 56卷 / 02期
关键词：
American sign language; arduino nano; google colab; neural network; !text type='python']python[!/text; slide potentiometer;
D O I：
10.5614/j.eng.technol.sci.2024.56.2.2
中图分类号：
学科分类号：
摘要：
This paper presents a system to translate gestures from the American Sign Language alphabet using an instrumented wearable glove. This system represents an attempt to utilize a slide potentiometer in sign language translating. The hardware part of the system consists of five slide potentiometers and two force-sensitive resistors, which are best positioned on a glove, based on the analysis of American Sign Language (ASL) letters. In the software part a neural network is used, which was built and trained using Google Colab and Python as the programming language. The performance of the system was tested on three data sets with different numbers of samples. After that, the letters corresponding to the gestures performed are displayed on a computer screen in real time. © 2024 Published by IRCS-ITB.
引用
收藏
页码：193 / 204
页数：11
相关论文
共 50 条
  • [1] A SPANISH SPEECH TO SIGN LANGUAGE TRANSLATION SYSTEM FOR ASSISTING DEAF-MUTE PEOPLE
    San-Segundo, R.
    Barra, R.
    D'Haro, L. F.
    Montero, J. M.
    Cordoba, R.
    Ferreiros, J.
    INTERSPEECH 2006 AND 9TH INTERNATIONAL CONFERENCE ON SPOKEN LANGUAGE PROCESSING, VOLS 1-5, 2006, : 1399 - 1402
  • [2] Text driven deaf-mute sign language synthesis system
    Song, Yibo
    Gao, Wen
    Yin, Baocai
    Liu, Ying
    Yan, Jie
    Xu, Lin
    Chen, Haitao
    Jisuanji Xuebao/Chinese Journal of Computers, 1999, 22 (07): : 733 - 739
  • [3] A Sign Language Recognition System Applied to Deaf-Mute Medical Consultation
    Xia, Kun
    Lu, Weiwei
    Fan, Hongliang
    Zhao, Qiang
    SENSORS, 2022, 22 (23)
  • [4] Sensor Based Hand Gesture Recognition System for English Alphabets used in Sign Language of Deaf-Mute People
    Jani, Abhishek B.
    Kotak, Nishith A.
    Roy, Anil K.
    2018 IEEE SENSORS, 2018, : 1523 - 1526
  • [5] A Multi-Modular Approach for Sign Language and Speech Recognition for Deaf-Mute People
    Dahanayaka, D. T. D. M.
    Madhusanka, B. G. D. A.
    Atthanayake, I. U.
    ENGINEER-JOURNAL OF THE INSTITUTION OF ENGINEERS SRI LANKA, 2021, 54 (04): : 97 - 105
  • [6] Sign Language Recognition Application Systems for Deaf-Mute People: A Review Based on Input-Process-Output
    Suharjito
    Anderson, Ricky
    Wiryana, Fanny
    Ariesta, Meita Chandra
    Kusuma, Gede Putra
    DISCOVERY AND INNOVATION OF COMPUTER SCIENCE TECHNOLOGY IN ARTIFICIAL INTELLIGENCE ERA, 2017, 116 : 441 - 448
  • [7] A NEW TYPE OF DEAF-MUTE SIGN LANGUAGE RECOGNITION SYSTEM BASED ON THE MOBILE COMMUNCIATION PLATFORM AND TERMINAL EQUIPMENT
    Zhao, Sining
    Wang, Maorong
    Wei, Zhen
    RESOURCES AND SUSTAINABLE DEVELOPMENT, PTS 1-4, 2013, 734-737 : 2880 - 2886
  • [8] Real-time Arabic avatar for deaf-mute communication enabled by deep learning sign language translation
    Talaat, Fatma M.
    El-Shafai, Walid
    Soliman, Naglaa F.
    Algarni, Abeer D.
    El-Samie, Fathi E. Abd
    Siam, Ali I.
    COMPUTERS & ELECTRICAL ENGINEERING, 2024, 119
  • [9] Intelligent gloves: An IT intervention for deaf-mute people
    Babour, Amal
    Bitar, Hind
    Alzamzami, Ohoud
    Alahmadi, Dimah
    Barsheed, Amal
    Alghamdi, Amal
    Almshjary, Hanadi
    JOURNAL OF INTELLIGENT SYSTEMS, 2023, 32 (01)
  • [10] An Avatar Based Translation System from Arabic Speech to Arabic Sign Language for Deaf People
    Halawani, Sami M.
    Daman, Daut
    Kari, Sarudin
    Ahmad, Ab Rahman
    INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2013, 13 (12): : 43 - 52
12345