A natural interface for sign language mathematics

被引:0
|
作者
Adamo-Villani, Nicoletta [1 ]
Benes, Bedrich [1 ]
Brisbin, Matt [1 ]
Hyland, Bryce [1 ]
机构
[1] Purdue Univ, W Lafayette, IN 47907 USA
来源
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The general goal of our research is the creation of a natural and intuitive interface for input and recognition of American Sign Language (ASL) math signs. The specific objective of this work is the development of two new interfaces for the Mathsigne(tm) application. Mathsigner(tm) is an interactive, 3D animation-based game designed to increase the mathematical skills of deaf children. The program makes use of standard input devices such as mouse and keyboard. In this paper we show a significant extension of the application by proposing two new user interfaces: (1) a glove-based interface, and (2) an interface based on the use of a specialized keyboard. So far, the interfaces allow for real-time input and recognition of the ASL numbers zero to twenty.
引用
收藏
页码:70 / +
页数:3
相关论文
共 50 条
  • [1] TOWARDS AN AMERICAN SIGN LANGUAGE INTERFACE
    DORNER, B
    HAGEN, E
    ARTIFICIAL INTELLIGENCE REVIEW, 1994, 8 (2-3) : 235 - 253
  • [2] Language change at the British sign language English interface
    Turner, GH
    CHANGE AND LANGUAGE, 1996, 10 : 64 - 72
  • [3] Sign systems as substitutes for natural language
    Frumkina, R. M.
    Braudo, T. Ye.
    KULTURNO-ISTORICHESKAYA PSIKHOLOGIYA-CULTURAL-HISTORICAL PSYCHOLOGY, 2006, 3 : 28 - 37
  • [4] Natural Language-Assisted Sign Language Recognition
    Zuo, Ronglai
    Wei, Fangyun
    Mak, Brian
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 14890 - 14900
  • [5] A Bilingual Social Robot with Sign Language and Natural Language
    Hei, Xiaoxuan
    Yu, Chuang
    Zhang, Heng
    Tapus, Adriana
    COMPANION OF THE 2024 ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION, HRI 2024 COMPANION, 2024, : 526 - 529
  • [6] Pedagogical Interface Agent for Kenya Sign Language
    Nyaga, Casam Njagi
    Wario, Ruth Diko
    De Wet, Lizette
    ADVANCES IN USABILITY, USER EXPERIENCE, WEARABLE AND ASSISTIVE TECHNOLOGY, AHFE 2021, 2021, 275 : 461 - 468
  • [7] Hardware natural language interface
    Pavlatos, C.
    Dimopoulos, A. C.
    Papakonstantinou, G.
    ARTIFICIAL INTELLIGENCE AND INNOVATIONS 2007: FROM THEORY TO APPLICATIONS, 2007, : 305 - +
  • [8] Natural language interface to an agent
    Kontos, J
    Malagardi, I
    Trikkalidis, D
    ADVANCES IN INTELLIGENT SYSTEMS: CONCEPTS, TOOLS AND APPLICATIONS, 1999, 21 : 211 - 218
  • [9] 3D sign language mathematics in immersive environment
    Adamo-Villani, Nicoletta
    Carpenter, Edward
    Arns, Laura
    PROCEEDINGS OF THE 15TH IASTED INTERNATIONAL CONFERENCE ON APPLIED SIMULATION AND MODELLING, 2006, : 382 - +