Animation of Fingerspelled Words and Number Signs of the Sinhala Sign Language

被引:8
|
作者
Punchimudiyanse, Malinda [1 ]
Meegama, Ravinda Gayan Narendra [2 ]
机构
[1] Open Univ Sri Lanka, Dept Comp Sci, Fac Nat Sci, Nawala 10250, Nugegoda, Sri Lanka
[2] Univ Sri Jayewardenepura, Fac Sci Appl, Dept Comp Sci, Gangodawila 10250, Nugegoda, Sri Lanka
基金
美国国家科学基金会;
关键词
Sinhala sign language; Sinhala fingerspelling; number gesture animation; 3D signing avatar;
D O I
10.1145/3092743
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Sign language is the primary communication medium of the aurally handicapped community. Often, a sign gesture is mapped to a word or a phrase in a spoken language and named as a conversational sign. A fingerspelling sign is a special sign derived to show a single character that matches a character in the alphabet of a given language. This enables the deaf community to express words that do not have a conversational sign, such as a name, using a letter-by-letter technique. Sinhala Sign Language (SSL) uses a phonetic pronunciation mechanism to decode such words due to the presence of one or more modifiers after a consonant. Expressing numbers also have a similar notation, and it is broken down into parts before interpretation in sign gestures. This article presents the variations implemented to make the 3D avatar-based interpreter system look similar to an actual fingerspelled SSL by a human interpreter. To accomplish the task, a phonetic English-based 3D avatar animation system is developed with Blender animation software. The conversion of Sinhala Unicode text to phonetic English and numbers written in digits to sign gestures is done with a Visual Basic.NET (VB.NET) application. The presented application has 61 SSL fingerspelling signs and 40 SSL number signs. It is capable of interpreting any word written using the modern Sinhala alphabet without conversational signs and interprets the numbers that go up to the billions. This is a helpful tool in teaching SSL fingerspelling and number signs of SSL to deaf children.
引用
收藏
页数:26
相关论文
共 50 条
  • [31] The Distribution of Signs in New Zealand Sign Language
    Mckee, David
    Kennedy, Graeme
    SIGN LANGUAGE STUDIES, 2006, 6 (04) : 372 - 390
  • [32] The first signs of language: Phonological development in British sign language
    Morgan, Gary
    Barrett-Jones, Sarah
    Stoneham, Helen
    APPLIED PSYCHOLINGUISTICS, 2007, 28 (01) : 3 - 22
  • [33] Recognition of isolated words of the Polish sign language
    Kapuscinski, T
    Wysocki, M
    Computer Recognition Systems, Proceedings, 2005, : 697 - 704
  • [34] MyWSL: Malaysian words sign language dataset
    Johari, Rina Tasia
    Ramli, Rizauddin
    Zulkoffli, Zuliani
    Saibani, Nizaroyani
    DATA IN BRIEF, 2023, 49
  • [35] Polish Sign Language Words Recognition with Kinect
    Oszust, Mariusz
    Wysocki, Marian
    2013 6TH INTERNATIONAL CONFERENCE ON HUMAN SYSTEM INTERACTIONS (HSI), 2013, : 219 - 226
  • [36] A Sign Language Dictionary in Internet with 3D Animation
    Gao, Qiang
    Zhu, Bin
    Shi, Yaohu
    Nishihara, Kazue
    CJCM: 5TH CHINA-JAPAN CONFERENCE ON MECHATRONICS 2008, 2008, : 147 - 148
  • [37] Toward an intuitive sign language animation authoring system for the deaf
    Alexis Heloir
    Fabrizio Nunnari
    Universal Access in the Information Society, 2016, 15 : 513 - 523
  • [38] Synthesis and Animation of Dynamic Hand Gestures for Sign Language Generation
    Verma, Vikas
    Ghosh, D.
    JOURNAL OF INTELLIGENT SYSTEMS, 2008, 17 (1-3) : 173 - 183
  • [39] Method for synthesizing animation to transmit sign language by intelligent communication
    Xu, Jun
    Aoki, Yoshinao
    Zheng, Zhong
    Electronics and Communications in Japan, Part III: Fundamental Electronic Science (English translation of Denshi Tsushin Gakkai Ronbunshi), 1993, 76 (02): : 108 - 117
  • [40] Toward an intuitive sign language animation authoring system for the deaf
    Heloir, Alexis
    Nunnari, Fabrizio
    UNIVERSAL ACCESS IN THE INFORMATION SOCIETY, 2016, 15 (04) : 513 - 523