Automatic Technologies for Processing Spoken Sign Languages

被引:11
|
作者
Karpov, Alexey [1 ]
Kipyatkova, Irina [1 ]
Zelezny, Milos [2 ]
机构
[1] Russian Acad Sci SPIIRAS, St Petersburg Inst Informat & Automat, St Petersburg, Russia
[2] UWB, Plzen, Czech Republic
关键词
Sign language; communication of deaf people; unwritten languages; multi-modal synthesis system; under-resourced languages; RECOGNITION;
D O I
10.1016/j.procs.2016.04.050
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Sign languages are known as a natural means for verbal communication of the deaf and hard of hearing people. There is no universal sign language, and almost each country has its own national sign language and fingerspelling alphabet. Sign languages use visual-kinetic clues for human-to-human communication combining hand gestures with lips articulation and facial mimics. They also possess a special grammar that is quite different from that of speech-based spoken languages. Sign languages are spoken (silently) by a hundred million deaf people all over the world and the most popular are American (ASL), Chinese, Brazilian, Russian, and British Sign Languages; there are almost 140 such languages according to the Ethnologue. They do not have a natural written form, and there is a huge lack of electronic resources for them, in particular, vocabularies, audio-visual databases, automatic recognition and synthesis systems, etc. Thus, sign languages may be considered as non-written under-resourced spoken languages. In this paper, we present a computer system for text-to-sign language synthesis for the Russian and Czech Sign Languages. (C) 2016 The Authors. Published by Elsevier B.V.
引用
收藏
页码:201 / 207
页数:7
相关论文
共 50 条
  • [1] Problems of researchers in the automatic processing of sign languages
    Cuxac, Christian
    Dalle, Patrice
    TRAITEMENT AUTOMATIQUE DES LANGUES, 2007, 48 (03): : 11 - 26
  • [2] PERCEPTION OF RATE IN SPOKEN AND SIGN LANGUAGES
    GROSJEAN, F
    PERCEPTION & PSYCHOPHYSICS, 1977, 22 (04): : 408 - 413
  • [4] "Talking heads" in Portuguese sign and spoken languages
    Cruz, Marisa
    Frota, Sonia
    LANGUAGE AND COGNITION, 2025, 17
  • [5] Linguistic Foundations of Narration in Spoken and Sign Languages
    Cheng, Yanhua
    DISCOURSE STUDIES, 2019, 21 (05) : 611 - 613
  • [6] Towards an open platform for machine translation of spoken languages into sign languages
    Costa, Rostand E. O.
    de Araujo, Tiago M. U.
    Lima, Manuella A. C. B.
    Verissimo, Vinicius M.
    de Andrade, Renan S.
    Vieira, Suanny F.
    Santos, Alexandre
    Souza Filho, Guido L.
    Soares, Marilia K.
    Hanael, Vitor
    MACHINE TRANSLATION, 2019, 33 (04) : 315 - 348
  • [7] Diversity across sign languages and spoken languages: Implications for language universals
    Cormier, Kearsy
    Schembri, Adam
    Woll, Bencie
    LINGUA, 2010, 120 (12) : 2664 - 2667
  • [8] An Open and Extensible Platform for Machine Translation of Spoken Languages into Sign Languages
    Costa, Rostand
    Maritan, Tiago
    Soares, Renan
    Verissimo, Vinicius
    Vieira, Suanny
    Santos, Alexandre
    Aschoff, Manuella
    Lemos, Guido
    APPLICATIONS AND USABILITY OF INTERACTIVE TELEVISION, JAUTI 2017, 2018, 813 : 161 - 176
  • [9] COMPUTER PROCESSING OF ASIAN SPOKEN LANGUAGES
    Zhang, Caicai
    Peng, Gang
    JOURNAL OF CHINESE LINGUISTICS, 2011, 39 (02) : 510 - 521
  • [10] Cultivating Spoken Language Technologies for Unwritten Languages
    Reitmaier, Thomas
    Raju, Dani Kalarikalayil
    Klejch, Ondrej
    Wallington, Electra
    Markl, Nina
    Pearson, Jennifer
    Jones, Matt
    Bell, Peter
    Robinson, Simon
    PROCEEDINGS OF THE 2024 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYTEMS, CHI 2024, 2024,