Multimodal human-machine interface devices in the cloud

被引:0
|
作者
B. Estrany
C. Marin
M. Mascaró
A. Bibiloni
Y. Luo
机构
[1] Universitat de les Illes Balears,
来源
关键词
Multimodal; Interface; SOA; Websocket; Virtual interface; Accessibility; MVCI;
D O I
暂无
中图分类号
学科分类号
摘要
In an increasingly connected and multidisciplinary world, we propose a new paradigm of web application development. It makes the whatever modal input to use the same interface to connect to the applications. It can essentially free the web application programmers and the end users from the need of physically handling the data input devices when they are building a multimodal system. The same application can be used for a whole range of physically different peripherals, but similar from the logical point of view of data entry. This paper discusses the implementation of a pilot project, currently in a local network environment, where all the devices in the LAN are identified and described in an interface server. Users in the local network may, upon request, make use of such devices. The communication of these peripherals with the web applications will be carried out by a network of modules that run under the websocket technology. The whole process of communication and connection establishment is automatic and guided by the existing configurations in the interface server. The entire platform runs under SOA strategy and is fully scalable and configurable. Its use is not limited to games because it has much wider possibilities, interactivity in teaching, accessibility for people with special needs, adaptation of web applications to the use of uninitiated, etc.
引用
收藏
页码:125 / 143
页数:18
相关论文
共 50 条
  • [1] Multimodal human-machine interface devices in the cloud
    Estrany, B.
    Marin, C.
    Mascaro, M.
    Bibiloni, A.
    Luo, Y.
    JOURNAL ON MULTIMODAL USER INTERFACES, 2018, 12 (02) : 125 - 143
  • [2] The design of multimodal human-machine interface for teleoperation
    Chou, WS
    Wang, TM
    2001 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS, VOLS 1-5: E-SYSTEMS AND E-MAN FOR CYBERNETICS IN CYBERSPACE, 2002, : 3187 - 3192
  • [3] Application of EEG for Multimodal Human-Machine Interface
    Park, Jangwoo
    Woo, Il
    Park, Shinsuk
    2012 12TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS), 2012, : 1869 - 1873
  • [4] Hybrid interface: Integrating BCI in Multimodal Human-Machine Interfaces
    Kalunga, Emmanuel K.
    Chevallier, Sylvain
    Rabreau, Olivier
    Monacelli, Eric
    2014 IEEE/ASME INTERNATIONAL CONFERENCE ON ADVANCED INTELLIGENT MECHATRONICS (AIM), 2014, : 530 - 535
  • [5] Multimodal human-machine interface based on a Brain-Computer Interface and an electrooculography interface
    Ianez, Eduardo
    Ubeda, Andres
    Azorin, Jose M.
    2011 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2011, : 4572 - 4575
  • [6] ON HUMAN-MACHINE INTERFACE
    BUHR, P
    COMMUNICATIONS OF THE ACM, 1983, 26 (07) : 463 - 464
  • [7] Soft Human-Machine Interface Sensing Displays: Materials and Devices
    Yu, Seunggun
    Park, Tae Hyun
    Jiang, Wei
    Lee, Seung Won
    Kim, Eui Hyuk
    Lee, Seokyeong
    Park, Jung-Eun
    Park, Cheolmin
    ADVANCED MATERIALS, 2023, 35 (43)
  • [8] Human-Machine Interface: Design Principles of Visual Information in Human-Machine Interface Design
    Gong Chao
    2009 INTERNATIONAL CONFERENCE ON INTELLIGENT HUMAN-MACHINE SYSTEMS AND CYBERNETICS, VOL 2, PROCEEDINGS, 2009, : 262 - 265
  • [9] Offloading Industrial Human-Machine Interaction Tasks to Mobile Devices and the Cloud
    Wang, Lingyun
    Canedo, Arquimedes
    2014 IEEE EMERGING TECHNOLOGY AND FACTORY AUTOMATION (ETFA), 2014,
  • [10] Study of human-machine physical interface for wearable mobility assist devices
    Levesque, Laurent
    Doumit, Marc
    MEDICAL ENGINEERING & PHYSICS, 2020, 80 : 33 - 43