Automatic Technologies for Processing Spoken Sign Languages

被引:11
|
作者
Karpov, Alexey [1 ]
Kipyatkova, Irina [1 ]
Zelezny, Milos [2 ]
机构
[1] Russian Acad Sci SPIIRAS, St Petersburg Inst Informat & Automat, St Petersburg, Russia
[2] UWB, Plzen, Czech Republic
关键词
Sign language; communication of deaf people; unwritten languages; multi-modal synthesis system; under-resourced languages; RECOGNITION;
D O I
10.1016/j.procs.2016.04.050
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Sign languages are known as a natural means for verbal communication of the deaf and hard of hearing people. There is no universal sign language, and almost each country has its own national sign language and fingerspelling alphabet. Sign languages use visual-kinetic clues for human-to-human communication combining hand gestures with lips articulation and facial mimics. They also possess a special grammar that is quite different from that of speech-based spoken languages. Sign languages are spoken (silently) by a hundred million deaf people all over the world and the most popular are American (ASL), Chinese, Brazilian, Russian, and British Sign Languages; there are almost 140 such languages according to the Ethnologue. They do not have a natural written form, and there is a huge lack of electronic resources for them, in particular, vocabularies, audio-visual databases, automatic recognition and synthesis systems, etc. Thus, sign languages may be considered as non-written under-resourced spoken languages. In this paper, we present a computer system for text-to-sign language synthesis for the Russian and Czech Sign Languages. (C) 2016 The Authors. Published by Elsevier B.V.
引用
收藏
页码:201 / 207
页数:7
相关论文
共 50 条
  • [41] Sign Languages
    Rankin, Miako
    SIGN LANGUAGE STUDIES, 2012, 13 (01) : 141 - 144
  • [42] Deep learning pathways for automatic sign language processing
    Toshpulatov, Mukhiddin
    Lee, Wookey
    Jun, Jaesung
    Lee, Suan
    PATTERN RECOGNITION, 2025, 164
  • [43] Sign languages
    Kimmelman, V. I.
    VOPROSY YAZYKOZNANIYA, 2011, (04): : 135 - 143
  • [44] Sign languages
    Arik, Engin
    CANADIAN JOURNAL OF LINGUISTICS-REVUE CANADIENNE DE LINGUISTIQUE, 2013, 58 (03): : 507 - 510
  • [45] Sign and Spoken Language Processing Differences in the Brain: A Brief Review of Recent Research
    Caldwell, Hayley Bree
    ANNALS OF NEUROSCIENCES, 2022, 29 (01) : 62 - 70
  • [46] The Vulnerability of Emerging Sign Languages: (E)merging Sign Languages?
    Jaraisy, Marah
    Stamp, Rose
    LANGUAGES, 2022, 7 (01)
  • [47] Morphosyntactic prediction in automatic neural processing of spoken language: EEG evidence
    Alekseeva, Maria
    Myachykov, Andriy
    Bermudez-Margaretto, Beatriz
    Shtyrov, Yury
    BRAIN RESEARCH, 2024, 1836
  • [48] Developmental change of ERP due to spoken pseudoword and phonological automatic processing
    Hosokawa, M
    Maekawa, H
    Ozaki, H
    INTERNATIONAL JOURNAL OF PSYCHOPHYSIOLOGY, 2004, 54 (1-2) : 87 - 88
  • [49] On the effects of automatic transcription and segmentation errors in Hungarian spoken language processing
    Tündik M.Á.
    Kaszás V.
    Szaszák G.
    Periodica polytechnica Electrical engineering and computer science, 2019, 63 (04): : 254 - 262
  • [50] LANGUAGE TECHNOLOGIES APPLIED TO THE PROCESSING OF INDIGENOUS LANGUAGES IN MEXICO: AN OVERVIEW
    Santiago, Cesar Antonio Aguilar
    Zuniga, Hamlet Antonio Garcia
    LINGUISTICA Y LITERATURA, 2023, (84): : 79 - 102