A multimodal interface framework for using hand gestures and speech in virtual environment applications

被引:0
|
作者
LaViola, JJ [1 ]
机构
[1] Brown Univ, NSF Sci & Technol Ctr Comp Graph & Sci Visualizat, Providence, RI 02912 USA
来源
GESTURE-BASED COMMUNICATION IN HUMAN-COMPUTER INTERACTION | 1999年 / 1739卷
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent approaches to providing users with a more natural method of interacting with virtual environment applications have shown that more than one mode of input can be both beneficial and intuitive as a communication medium between humans and computer applications. Hand gestures and speech appear to be two of the most logical since users will typically be in environments that will have them immersed in a virtual world with limited access to traditional input devices such as the keyboard or the mouse. In this paper, we describe an ongoing research project to develop multimodal interfaces that incorporate 3D hand gestures and speech in virtual environments.
引用
收藏
页码:303 / 314
页数:12
相关论文
共 50 条
  • [21] Multimodal biometric authentication using speech and hand geometry fusion
    Varchol, P.
    Levicky, D.
    Juhar, J.
    PROCEEDINGS OF IWSSIP 2008: 15TH INTERNATIONAL CONFERENCE ON SYSTEMS, SIGNALS AND IMAGE PROCESSING, 2008, : 57 - 60
  • [22] Intuitive Cognition-Based Method for Generating Speech Using Hand Gestures
    Holdengreber, Eldad
    Yozevitch, Roi
    Khavkin, Vitali
    SENSORS, 2021, 21 (16)
  • [23] Research on framework of high level architecture interface of virtual environment for virtual prototyping
    Xiao-Hua, Wang
    Tian-Wen, Zhang
    Xu-dong, Chai
    Ming-Yu, Zhao
    ISTM/2007: 7TH INTERNATIONAL SYMPOSIUM ON TEST AND MEASUREMENT, VOLS 1-7, CONFERENCE PROCEEDINGS, 2007, : 5841 - 5846
  • [24] Controlling Continuous Locomotion in Virtual Reality with Bare Hands Using Hand Gestures
    Schaefer, Alexander
    Reis, Gerd
    Stricker, Didier
    VIRTUAL REALITY AND MIXED REALITY (EUROXR 2022), 2022, 13484 : 191 - 205
  • [25] Easy-to-use virtual brick manipulation techniques using hand gestures
    Van Thanh Tran
    Jaewoon Lee
    Dongho Kim
    Young-Sik Jeong
    The Journal of Supercomputing, 2016, 72 : 2752 - 2766
  • [26] Easy-to-use virtual brick manipulation techniques using hand gestures
    Van Thanh Tran
    Lee, Jaewoon
    Kim, Dongho
    Jeong, Young-Sik
    JOURNAL OF SUPERCOMPUTING, 2016, 72 (07): : 2752 - 2766
  • [27] Visual-based human-machine interface using hand gestures
    Chalechale, Abdolah
    Naghdy, Golshah
    2007 9TH INTERNATIONAL SYMPOSIUM ON SIGNAL PROCESSING AND ITS APPLICATIONS, VOLS 1-3, 2007, : 113 - +
  • [28] Animating Various Characters using Arm Gestures in Virtual Reality Environment
    Saito, Tsubasa
    Ijiri, Takashi
    ADJUNCT PROCEEDINGS OF THE 34TH ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE AND TECHNOLOGY, UIST 2021, 2021, : 29 - 31
  • [29] Qualitative Analysis of a Multimodal Interface System using Speech/Gesture
    Baig, Muhammad Zeeshan
    Kavakli, Manolya
    PROCEEDINGS OF THE 2018 13TH IEEE CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA 2018), 2018, : 2811 - 2816
  • [30] A Framework for the Development of Applications Allowing Multimodal Interaction with Virtual Reality Worlds
    Olmedo-Rodriguez, Hector
    Cardenoso-Payo, Valentin
    Escudero-Mancebo, David
    WSCG 2008, COMMUNICATION PAPERS, 2008, : 79 - 86