Enhancing Communication Accessibility: A Deep Learning Approach to Gesture Recognition for the Deaf and Mute Community

被引:0
|
作者
Kandula, Ashok Reddy [1 ]
Ramachandran, Priya Darshini [1 ]
Tummalapalli, Nikhitha [1 ]
Tirukkovalluri, Krishna Priya [1 ]
Kothapalli, Kavya [1 ]
机构
[1] Seshadri Rao Gudlavalleru Engn Coll, Dept AI & DS, Gudlavalleru, India
关键词
Recurrent Neural Network; long short-term memory; OpenCV; Media pipe; Rectified Linear Unit; SoftMax; Adam Optimizer; Gesture Classification;
D O I
10.1109/ICPCSN62568.2024.00142
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Though human communication is crucial, individuals with physical obstacles like deafness and naivety frequently find it challenging to communicate effectively. Utilizing sign language can be a primitive component of communication among this group. This paper suggests a creative approach to closing the communication hole by engaging the comprehension of sign dialect without the prerequisite for people to memorize it. Tallying flag recording on webcams gives a successful and straightforward means of collecting data. These hand advancements are meticulously recorded and utilized as the primitive for planning and testing models. The credibility of pushing for inclusivity exists, as does the potential for making more effective communication channels that cater to assorted social classes. Sign tongue isn't a burdensome errand due to the effortlessness of this procedure, which makes communication less demanding. Through this unused approach, social instinct will progress through predominant communication, frequent understanding, and support among particular levels of society. In this way, this movement has the potential to begin noteworthy updates in interpersonal associations, develop inclusivity, and address existing boundaries for fruitful communication. This research work attempted it more than once and were attained a better accuracy of 90%.
引用
收藏
页码:842 / 849
页数:8
相关论文
共 50 条
  • [21] Soft Optoelectronic Sensors with Deep Learning for Gesture Recognition
    Zhao, Lei
    Wu, Bei
    Niu, Yao
    Zhu, Shengke
    Chen, Ye
    Chen, Huanyang
    Chen, Jin-hui
    ADVANCED MATERIALS TECHNOLOGIES, 2022, 7 (11)
  • [22] Design of gesture recognition system based on Deep Learning
    Niu, Qiya
    Teng, Yunlai
    Chen, Lin
    2018 INTERNATIONAL CONFERENCE ON COMPUTER INFORMATION SCIENCE AND APPLICATION TECHNOLOGY, 2019, 1168
  • [23] Deep Learning for Hand Gesture Recognition on Skeletal Data
    Devineau, Guillaume
    Xi, Wang
    Moutarde, Fabien
    Yang, Jie
    PROCEEDINGS 2018 13TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE & GESTURE RECOGNITION (FG 2018), 2018, : 106 - 113
  • [24] Deep transfer learning for gesture recognition with WiFi signals
    Bu Q.
    Yang G.
    Ming X.
    Zhang T.
    Feng J.
    Zhang J.
    Personal and Ubiquitous Computing, 2022, 26 (03) : 543 - 554
  • [25] Research on the Hand Gesture Recognition Based on Deep Learning
    Sun, Jing-Hao
    Ji, Ting-Ting
    Zhang, Shu-Bin
    Yang, Jia-Kui
    Ji, Guang-Rong
    2018 12TH INTERNATIONAL SYMPOSIUM ON ANTENNAS, PROPAGATION AND ELECTROMAGNETIC THEORY (ISAPE), 2018,
  • [26] Integrated Deep Learning Structures for Hand Gesture Recognition
    Korkmaz, Senol
    13TH INTERNATIONAL CONFERENCE ON THEORY AND APPLICATION OF FUZZY SYSTEMS AND SOFT COMPUTING - ICAFS-2018, 2019, 896 : 129 - 136
  • [27] Gesture Recognition Based on Deep Learning in Complex Scenes
    Wang Nan
    Zhou Zhigang
    Lei Huan
    Ma Jingqi
    Zhuang Jiajun
    Duan Guangxue
    PROCEEDINGS OF THE 2019 31ST CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2019), 2019, : 630 - 634
  • [28] Small Deep Learning Models For Hand Gesture Recognition
    Mohammed, Adam Ahmed Qaid
    Lv, Jiancheng
    Islam, M. D. Sajjatul
    2019 IEEE INTL CONF ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, BIG DATA & CLOUD COMPUTING, SUSTAINABLE COMPUTING & COMMUNICATIONS, SOCIAL COMPUTING & NETWORKING (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2019), 2019, : 1429 - 1435
  • [29] A Multi-Modular Approach for Sign Language and Speech Recognition for Deaf-Mute People
    Dahanayaka, D. T. D. M.
    Madhusanka, B. G. D. A.
    Atthanayake, I. U.
    ENGINEER-JOURNAL OF THE INSTITUTION OF ENGINEERS SRI LANKA, 2021, 54 (04): : 97 - 105
  • [30] Gesture recognition approach based on learning sparse representation
    Xiao, L., 1600, Editorial Board of Journal on Communications (34):