Animation of Fingerspelled Words and Number Signs of the Sinhala Sign Language

被引:8
|
作者
Punchimudiyanse, Malinda [1 ]
Meegama, Ravinda Gayan Narendra [2 ]
机构
[1] Open Univ Sri Lanka, Dept Comp Sci, Fac Nat Sci, Nawala 10250, Nugegoda, Sri Lanka
[2] Univ Sri Jayewardenepura, Fac Sci Appl, Dept Comp Sci, Gangodawila 10250, Nugegoda, Sri Lanka
基金
美国国家科学基金会;
关键词
Sinhala sign language; Sinhala fingerspelling; number gesture animation; 3D signing avatar;
D O I
10.1145/3092743
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Sign language is the primary communication medium of the aurally handicapped community. Often, a sign gesture is mapped to a word or a phrase in a spoken language and named as a conversational sign. A fingerspelling sign is a special sign derived to show a single character that matches a character in the alphabet of a given language. This enables the deaf community to express words that do not have a conversational sign, such as a name, using a letter-by-letter technique. Sinhala Sign Language (SSL) uses a phonetic pronunciation mechanism to decode such words due to the presence of one or more modifiers after a consonant. Expressing numbers also have a similar notation, and it is broken down into parts before interpretation in sign gestures. This article presents the variations implemented to make the 3D avatar-based interpreter system look similar to an actual fingerspelled SSL by a human interpreter. To accomplish the task, a phonetic English-based 3D avatar animation system is developed with Blender animation software. The conversion of Sinhala Unicode text to phonetic English and numbers written in digits to sign gestures is done with a Visual Basic.NET (VB.NET) application. The presented application has 61 SSL fingerspelling signs and 40 SSL number signs. It is capable of interpreting any word written using the modern Sinhala alphabet without conversational signs and interprets the numbers that go up to the billions. This is a helpful tool in teaching SSL fingerspelling and number signs of SSL to deaf children.
引用
收藏
页数:26
相关论文
共 50 条
  • [1] Automatic Recognition of Fingerspelled Words in British Sign Language
    Liwicki, Stephan
    Everingham, Mark
    2009 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPR WORKSHOPS 2009), VOLS 1 AND 2, 2009, : 809 - +
  • [2] The neural circuits recruited for the production of signs and fingerspelled words
    Emmorey, Karen
    Mehta, Sonya
    McCullough, Stephen
    Grabowski, Thomas J.
    BRAIN AND LANGUAGE, 2016, 160 : 30 - 41
  • [3] Spotting Fingerspelled Words from Sign Language Video by Temporally Regularized Canonical Component Analysis
    Tanaka, Shohei
    Okazaki, Akio
    Kato, Nobuko
    Hino, Hideitsu
    Fukui, Kazuhiro
    2016 IEEE INTERNATIONAL CONFERENCE ON IDENTITY, SECURITY AND BEHAVIOR ANALYSIS (ISBA), 2016,
  • [4] Searching for fingerspelled content in American Sign Language
    Shi, Bowen
    Brentari, Diane
    Shakhnarovich, Greg
    Livescu, Karen
    PROCEEDINGS OF THE 60TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), VOL 1: (LONG PAPERS), 2022, : 1699 - 1712
  • [5] SignQuiz: A Quiz Based Tool for Learning Fingerspelled Signs in Indian Sign Language Using ASLR
    Joy, Jestin
    Balakrishnan, Kannan
    Sreeraj, M.
    IEEE ACCESS, 2019, 7 : 28363 - 28371
  • [6] Unsupervised Discovery of Fingerspelled Letters in Sign Language Videos
    Duman, Feyza
    Ipek, Tanya Deniz
    Saraclar, Murat
    29TH IEEE CONFERENCE ON SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS (SIU 2021), 2021,
  • [7] Unknown Words Analysis in POS tagging of Sinhala Language
    Jayaweera, A. J. P. M. P.
    Dias, N. G. J.
    14TH INTERNATIONAL CONFERENCE ON ADVANCES IN ICT FOR EMERGING REGIONS (ICTER) 2014, 2014, : 270 - 270
  • [8] MEMORY FOR NON-SEMANTIC ATTRIBUTES OF AMERICAN SIGN LANGUAGE SIGNS AND ENGLISH WORDS
    SIPLE, P
    FISCHER, SD
    BELLUGI, U
    JOURNAL OF VERBAL LEARNING AND VERBAL BEHAVIOR, 1977, 16 (05): : 561 - 574
  • [9] 3D Signing Avatar for Sinhala Sign Language
    Punchimudiyanse, M.
    Meegama, R. G. N.
    2015 IEEE 10TH INTERNATIONAL CONFERENCE ON INDUSTRIAL AND INFORMATION SYSTEMS (ICIIS), 2015, : 290 - 295
  • [10] Sociolinguistic Variation and Change in British Sign Language Number Signs: Evidence of Leveling?
    Stamp, Rose
    Schembri, Adam
    Fenlon, Jordan
    Rentelis, Ramas
    SIGN LANGUAGE STUDIES, 2015, 15 (02) : 151 - 181