Tracking gaze position from EEG: Exploring the possibility of an EEG-based virtual eye-tracker

被引:1
|
作者
Sun, Rui [1 ,3 ]
Cheng, Andy S. K. [1 ]
Chan, Cynthia [2 ]
Hsiao, Janet [2 ]
Privitera, Adam J. [7 ]
Gao, Junling [4 ]
Fong, Ching-hang [1 ]
Ding, Ruoxi [5 ]
Tang, Akaysha C. [3 ,6 ,8 ]
机构
[1] Hong Kong Polytech Univ, Dept Rehabil Sci, Hong Kong, Peoples R China
[2] Univ Hong Kong, Dept Psychol, Hong Kong, Peoples R China
[3] Univ Hong Kong, Lab Neurosci Educ, Hong Kong, Peoples R China
[4] Univ Hong Kong, Ctr Buddhism Studies, Hong Kong, Peoples R China
[5] Peking Univ, China Ctr Hlth Dev Studies, Beijing, Peoples R China
[6] Neural Dialogue, Shenzhen, Peoples R China
[7] Nanyang Technol Univ, Ctr Res & Dev Learning, Singapore, Singapore
[8] Neural Dialogue, Suite E 2213, 16 Hongshang Rd, Shenzhen 518110, Peoples R China
来源
BRAIN AND BEHAVIOR | 2023年 / 13卷 / 10期
关键词
BSS; eye movement; high-density EEG; ICA; saccade; SOBI; smooth pursuit; BLIND SOURCE SEPARATION; INDEPENDENT COMPONENTS; ARTIFACT ELIMINATION; AUTOMATIC REMOVAL; OCULAR ARTIFACTS; COMBINING EEG; MOVEMENT; IDENTIFICATION; ELECTROENCEPHALOGRAM; SIGNALS;
D O I
10.1002/brb3.3205
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
Introduction: Ocular artifact has long been viewed as an impediment to the interpretation of electroencephalogram (EEG) signals in basic and applied research. Today, the use of blind source separation (BSS) methods, including independent component analysis (ICA) and second-order blind identification (SOBI), is considered an essential step in improving the quality of neural signals. Recently, we introduced amethod consisting of SOBI and a discriminant and similarity (DANS)-based identification method, capable of identifying and extracting eye movement-related components. These recovered components can be localized within ocular structures with a high goodness of fit (>95%). This raised the possibility that such EEG-derived SOBI components may be used to build predictive models for tracking gaze position. Methods: As proof of this new concept, we designed an EEG-based virtual eye-tracker (EEG-VET) for tracking eye movement from EEG alone. The EEG-VET is composed of a SOBI algorithm for separating EEG signals into different components, a DANS algorithm for automatically identifying ocular components, and a linear model to transfer ocular components into gaze positions. Results: The prototype of EEG-VET achieved an accuracy of 0.920 degrees and precision of 1.510 degrees of a visual angle in the best participant, whereas an average accuracy of 1.008 degrees +/- 0.357 degrees and a precision of 2.348 degrees +/- 0.580 degrees of a visual angle across all participants (N = 18). Conclusion: This work offers a novel approach that readily co-registers eye movement and neural signals from a single-EEG recording, thus increasing the ease of studying neural mechanisms underlying natural cognition in the context of free eye movement.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Virtual Reality Enhances EEG-Based Neurofeedback for Emotional Self-regulation
    Arpaia, Pasquale
    Coyle, Damien
    D'Errico, Giovanni
    De Benedetto, Egidio
    De Paolis, Lucio Tommaso
    du Bois, Naomi
    Grassini, Sabrina
    Mastrati, Giovanna
    Moccaldi, Nicola
    Vallefuoco, Ersilia
    EXTENDED REALITY, XR SALENTO 2022, PT II, 2022, 13446 : 420 - 431
  • [42] An EEG-Based Investigation of the Effect of Perceived Observation on Visual Memory in Virtual Environments
    Darfler, Michael
    Cruz-Garza, Jesus G.
    Kalantari, Saleh
    BRAIN SCIENCES, 2022, 12 (02)
  • [43] EEG-Based Affect and Workload Recognition in a Virtual Driving Environment for ASD Intervention
    Fan, Jing
    Wade, Joshua W.
    Key, Alexandra P.
    Warren, Zachary E.
    Sarkar, Nilanjan
    IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2018, 65 (01) : 43 - 51
  • [44] EEG-based navigation of immersing virtual environment using common spatial patterns
    Fujisawa, Junya
    Touyama, Hideaki
    Hirose, Michitaka
    IEEE VIRTUAL REALITY 2008, PROCEEDINGS, 2008, : 251 - 252
  • [45] Exploring Relevant Features for EEG-Based Investigation of Sound Perception in Naturalistic Soundscapes
    Haupt, Thorge
    Rosenkranz, Marc
    Bleichner, Martin G.
    ENEURO, 2025, 12 (01)
  • [46] Exploring Differential Entropy and Multifractal Cumulants for EEG-based Mental Workload Recognition
    Lu, Yan
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2024, 15 (05) : 134 - 141
  • [47] Eye Tracking and Gaze Based Interaction within Immersive Virtual Environments
    Haffegee, Adrian
    Barrow, Russell
    COMPUTATIONAL SCIENCE - ICCS 2009, 2009, 5545 : 729 - 736
  • [48] A robust eye gaze tracking method based on a virtual eyeball model
    Lee, Eui Chul
    Park, Kang Ryoung
    MACHINE VISION AND APPLICATIONS, 2009, 20 (05) : 319 - 337
  • [49] A robust eye gaze tracking method based on a virtual eyeball model
    Eui Chul Lee
    Kang Ryoung Park
    Machine Vision and Applications, 2009, 20 : 319 - 337
  • [50] Development of a Hybrid Mental Speller Combining EEG-Based Brain-Computer Interface and Webcam-Based Eye-Tracking
    Lee, Jun-Hak
    Lim, Jeong-Hwan
    Hwang, Han-Jeong
    Im, Chang-Hwan
    2013 35TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2013, : 2240 - 2242