Automatic Technologies for Processing Spoken Sign Languages

被引:11
|
作者
Karpov, Alexey [1 ]
Kipyatkova, Irina [1 ]
Zelezny, Milos [2 ]
机构
[1] Russian Acad Sci SPIIRAS, St Petersburg Inst Informat & Automat, St Petersburg, Russia
[2] UWB, Plzen, Czech Republic
关键词
Sign language; communication of deaf people; unwritten languages; multi-modal synthesis system; under-resourced languages; RECOGNITION;
D O I
10.1016/j.procs.2016.04.050
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Sign languages are known as a natural means for verbal communication of the deaf and hard of hearing people. There is no universal sign language, and almost each country has its own national sign language and fingerspelling alphabet. Sign languages use visual-kinetic clues for human-to-human communication combining hand gestures with lips articulation and facial mimics. They also possess a special grammar that is quite different from that of speech-based spoken languages. Sign languages are spoken (silently) by a hundred million deaf people all over the world and the most popular are American (ASL), Chinese, Brazilian, Russian, and British Sign Languages; there are almost 140 such languages according to the Ethnologue. They do not have a natural written form, and there is a huge lack of electronic resources for them, in particular, vocabularies, audio-visual databases, automatic recognition and synthesis systems, etc. Thus, sign languages may be considered as non-written under-resourced spoken languages. In this paper, we present a computer system for text-to-sign language synthesis for the Russian and Czech Sign Languages. (C) 2016 The Authors. Published by Elsevier B.V.
引用
收藏
页码:201 / 207
页数:7
相关论文
共 50 条
  • [31] The role of spoken and sign languages in the retention of written words by prelingually deafened native signers
    Miller, Paul
    JOURNAL OF DEAF STUDIES AND DEAF EDUCATION, 2007, 12 (02): : 184 - 208
  • [32] Relationships Between Spoken Word and Sign Processing in Children With Cochlear Implants
    Giezen, Marcel R.
    Baker, Anne E.
    Escudero, Paola
    JOURNAL OF DEAF STUDIES AND DEAF EDUCATION, 2014, 19 (01): : 107 - 125
  • [33] DenseRecognition of Spoken Languages
    Chakraborty, Jaybrata
    Chakraborty, Bappaditya
    Bhattacharya, Ujjwal
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 9674 - 9681
  • [34] Languages spoken in Asia
    不详
    ANTHROPOLOGIE, 1948, 52 (03): : 520 - 521
  • [35] SPOKEN LANGUAGES, WRITTEN LANGUAGES, PLANNED LANGUAGES - AN INTRODUCTION
    POSNER, R
    ZEITSCHRIFT FUR SEMIOTIK, 1983, 5 (04): : 311 - 329
  • [36] STATE AND THE LANGUAGES SPOKEN IN IT
    KNAPPERT, J
    LINGUISTICS, 1978, (214) : 69 - 76
  • [38] A mechanism for personalized Automatic Speech Recognition for less frequently spoken languages: the Greek case
    Antoniadis, Panagiotis
    Tsardoulias, Emmanouil
    Symeonidis, Andreas
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (28) : 40635 - 40652
  • [39] Automatic detection of Parkinson's disease in running speech spoken in three different languages
    Orozco-Arroyave, J. R.
    Hoenig, F.
    Arias-Londono, J. D.
    Vargas-Bonilla, J. F.
    Daqrouq, K.
    Skodda, S.
    Rusz, J.
    Noeth, E.
    JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2016, 139 (01): : 481 - 500
  • [40] A mechanism for personalized Automatic Speech Recognition for less frequently spoken languages: the Greek case
    Panagiotis Antoniadis
    Emmanouil Tsardoulias
    Andreas Symeonidis
    Multimedia Tools and Applications, 2022, 81 : 40635 - 40652