[DEMO] G-SIAR: Gesture-Speech Interface for Augmented Reality

被引：0
|
作者：
Piumsomboon, Thammathip [1 ]
Clark, Adrian [1 ]
Billinghurst, Mark [1 ]
机构：
[1] Univ Canterbury, HITLab NZ, Canterbury, New Zealand
来源：
2014 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY (ISMAR) - SCIENCE AND TECHNOLOGY | 2014年
关键词：
Augmented reality; natural interaction; multimodal interface; H.5.2. User Interfaces: Interaction styles; usercentered design;
D O I：
暂无
中图分类号：
TP3 [计算技术、计算机技术];
学科分类号：
0812 ;
摘要：
We demonstrate an Augmented Reality (AR) system that utilizes a combination of direct free hand interaction and indirect multimodal gesture and speech interface. A three-dimensional (3D) design sandbox application, featuring online object creation, has been developed to illustrate the use case of our system that supports dual interaction techniques.
引用
收藏
页码：365 / 366
页数：2
相关论文
共 20 条
  • [1] Grasp-Shell vs Gesture-Speech: A Comparison of Direct and Indirect Natural Interaction Techniques in Augmented Reality
    Piumsomboon, Thammathip
    Altimira, David
    Kim, Hyungon
    Clark, Adrian
    Lee, Gun
    Billinghurst, Mark
    2014 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY (ISMAR) - SCIENCE AND TECHNOLOGY, 2014, : 73 - 82
  • [2] Using Hand Gesture and Speech in a Multimodal Augmented Reality Environment
    Dias, Miguel Sales
    Bastos, Rafael
    Fernandes, Joao
    Tavares, Joao
    Santos, Pedro
    GESTURE-BASED HUMAN-COMPUTER INTERACTION AND SIMULATION, 2009, 5085 : 175 - +
  • [3] Multimodal Fusion: Gesture and Speech Input in Augmented Reality Environment
    Ismail, Ajune Wanis
    Sunar, Mohd Shahrizal
    COMPUTATIONAL INTELLIGENCE IN INFORMATION SYSTEMS, 2015, 331 : 245 - 254
  • [4] Gesture Controlled Tactile Augmented Reality Interface for the Visually Impaired
    Kalra, Siddharth
    Jain, Sarika
    Agarwal, Amit
    JOURNAL OF INFORMATION TECHNOLOGY RESEARCH, 2021, 14 (02) : 125 - 151
  • [5] Interaction With Gaze, Gesture, and Speech in a Flexibly Configurable Augmented Reality System
    Wang, Zhimin
    Wang, Haofei
    Yu, Huangyue
    Lu, Feng
    IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2021, 51 (05) : 524 - 534
  • [6] Development of a Silent Speech Interface for Augmented Reality Applications
    Walck, Christine
    Rivas, Tania
    Flanagan, Riley
    Fornito, Michael
    COMPUTER METHODS, IMAGING AND VISUALIZATION IN BIOMECHANICS AND BIOMEDICAL ENGINEERING II, 2023, 38 : 208 - 214
  • [7] Computer vision-based gesture recognition for an augmented reality interface
    Störring, M
    Moeslund, TB
    Liu, Y
    Granum, E
    PROCEEDINGS OF THE FOURTH IASTED INTERNATIONAL CONFERENCE ON VISUALIZATION, IMAGING, AND IMAGE PROCESSING, 2004, : 766 - 771
  • [8] SARIM: A Gesture-based Sound Augmented Reality Interface for visiting museums
    Kaghat, Fatima Zahra
    Azough, Ahmed
    Fakhour, Mohammed
    2018 INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS AND COMPUTER VISION (ISCV2018), 2018,
  • [9] An evaluation of an augmented reality multimodal interface using speech and paddle gestures
    Irawati, Sylvia
    Green, Scott
    Billinghurst, Mark
    Duenser, Andreas
    Ko, Heedong
    ADVANCES IN ARTIFICIAL REALITY AND TELE-EXISTENCE, PROCEEDINGS, 2006, 4282 : 272 - 283
  • [10] Designing an Augmented Reality Multimodal Interface for 6DOF Manipulation Techniques Multimodal Fusion Using Gesture and Speech Input for AR
    Ismail, Ajune Wanis
    Billinghurst, Mark
    Sunar, Mohd Shahrizal
    Yusof, Cik Suhaimi
    INTELLIGENT SYSTEMS AND APPLICATIONS, VOL 1, 2019, 868 : 309 - 322
12