Multi-Modal Interface for Communication Operated by Eye Blinks, Eye Movements, Head Movements, Blowing/Sucking and Brain Waves

被引:0
|
作者
Bastos-Filho, Teodiano [1 ]
Ferreira, Andre [1 ]
Cavalieri, Daniel [1 ]
Silva, Rafael [1 ]
Muller, Sandra [1 ]
Perez, Elisa [1 ]
机构
[1] Univ Fed Espirito Santo, Vitoria, Brazil
关键词
COMPUTER INTERFACES; BCI;
D O I
暂无
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
This work presents a multi-modal interface that can be used for communication of people with disabilities. The interface is installed onboard a robotic wheelchair, and provides flexibility to choose different modalities for communication by people with different levels of disabilities. Users can use the interface through eye blinks, eye movements, head movements, by blowing or sucking a straw, and through brain signals. The interface is easy to use and has a flexible graphical user interface running on a personal digital assistant or tablet. Several experiments were carried out with healthy people and people with disabilities, and the results validate the developed interface as an assistive tool to allow communication of people with distinct levels of disability.
引用
收藏
页码:55 / 60
页数:6
相关论文
共 24 条
  • [1] Head movement compensation and multi-modal event detection in eye-tracking data for unconstrained head movements
    Larsson, Linnea
    Schwaller, Andrea
    Nystrom, Marcus
    Stridh, Martin
    JOURNAL OF NEUROSCIENCE METHODS, 2016, 274 : 13 - 26
  • [2] Brain-machine interface for eye movements
    Graf, Arnulf B. A.
    Andersen, Richard A.
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2014, 111 (49) : 17630 - 17635
  • [3] Discrimination of Eye Blinks and Eye Movements as Features for Image Analysis of the Around Ocular Region for Use as an Input Interface
    Matsuno, Shogo
    Tanaka, Masatoshi
    Yoshida, Keisuke
    Akehi, Kota
    Itakura, Naoaki
    Mizuno, Tota
    Mito, Kazuyuki
    INNOVATIVE MOBILE AND INTERNET SERVICES IN UBIQUITOUS COMPUTING, IMIS-2018, 2019, 773 : 171 - 182
  • [4] Therapainting: Interactive Art-Therapy Tool Based on Head Movements and Eye Blinks
    Gonzalez-Martinez, Fernando
    Alonso-Valerdi, Luz Maria
    Ibarra-Zarate, David I.
    VIII LATIN AMERICAN CONFERENCE ON BIOMEDICAL ENGINEERING AND XLII NATIONAL CONFERENCE ON BIOMEDICAL ENGINEERING, 2020, 75 : 1101 - 1106
  • [5] Multi-modal user interface combining eye tracking and hand gesture recognition
    Kim, Hansol
    Suh, Kun Ha
    Lee, Eui Chul
    JOURNAL ON MULTIMODAL USER INTERFACES, 2017, 11 (03) : 241 - 250
  • [6] Multi-modal user interface combining eye tracking and hand gesture recognition
    Hansol Kim
    Kun Ha Suh
    Eui Chul Lee
    Journal on Multimodal User Interfaces, 2017, 11 : 241 - 250
  • [7] Effect of deep brain stimulation on eye and head movements in Parkinson's disease
    Wetzel, PA
    Felton, WL
    Holloway, KL
    Seel, RT
    Haselman, M
    Eubank, N
    INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2003, 44 : U313 - U313
  • [8] Human-computer interface controlled by horizontal directional eye movements and voluntary blinks using AC EOG signals
    Graduate School of Natural Science and Technology, Kanazawa University, Kakuma, Kanazawa, Ishikawa 920-1192, Japan
    不详
    IEEJ Trans. Electron. Inf. Syst., 4 (555-560): : 555 - 560
  • [9] EYE-MOVEMENTS AND BRAIN-STEM DYSFUNCTION AFTER HEAD-INJURY
    TEASDALE, G
    SMITH, J
    JOURNAL OF NEUROLOGY NEUROSURGERY AND PSYCHIATRY, 1975, 38 (08): : 822 - 823
  • [10] EarSet: A Multi-Modal Dataset for Studying the Impact of Head and Facial Movements on In-Ear PPG Signals
    Montanari, Alessandro
    Ferlini, Andrea
    Balaji, Ananta Narayanan
    Mascolo, Cecilia
    Kawsar, Fahim
    SCIENTIFIC DATA, 2023, 10 (01)