Tracking gaze position from EEG: Exploring the possibility of an EEG-based virtual eye-tracker

被引:1
|
作者
Sun, Rui [1 ,3 ]
Cheng, Andy S. K. [1 ]
Chan, Cynthia [2 ]
Hsiao, Janet [2 ]
Privitera, Adam J. [7 ]
Gao, Junling [4 ]
Fong, Ching-hang [1 ]
Ding, Ruoxi [5 ]
Tang, Akaysha C. [3 ,6 ,8 ]
机构
[1] Hong Kong Polytech Univ, Dept Rehabil Sci, Hong Kong, Peoples R China
[2] Univ Hong Kong, Dept Psychol, Hong Kong, Peoples R China
[3] Univ Hong Kong, Lab Neurosci Educ, Hong Kong, Peoples R China
[4] Univ Hong Kong, Ctr Buddhism Studies, Hong Kong, Peoples R China
[5] Peking Univ, China Ctr Hlth Dev Studies, Beijing, Peoples R China
[6] Neural Dialogue, Shenzhen, Peoples R China
[7] Nanyang Technol Univ, Ctr Res & Dev Learning, Singapore, Singapore
[8] Neural Dialogue, Suite E 2213, 16 Hongshang Rd, Shenzhen 518110, Peoples R China
来源
BRAIN AND BEHAVIOR | 2023年 / 13卷 / 10期
关键词
BSS; eye movement; high-density EEG; ICA; saccade; SOBI; smooth pursuit; BLIND SOURCE SEPARATION; INDEPENDENT COMPONENTS; ARTIFACT ELIMINATION; AUTOMATIC REMOVAL; OCULAR ARTIFACTS; COMBINING EEG; MOVEMENT; IDENTIFICATION; ELECTROENCEPHALOGRAM; SIGNALS;
D O I
10.1002/brb3.3205
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
Introduction: Ocular artifact has long been viewed as an impediment to the interpretation of electroencephalogram (EEG) signals in basic and applied research. Today, the use of blind source separation (BSS) methods, including independent component analysis (ICA) and second-order blind identification (SOBI), is considered an essential step in improving the quality of neural signals. Recently, we introduced amethod consisting of SOBI and a discriminant and similarity (DANS)-based identification method, capable of identifying and extracting eye movement-related components. These recovered components can be localized within ocular structures with a high goodness of fit (>95%). This raised the possibility that such EEG-derived SOBI components may be used to build predictive models for tracking gaze position. Methods: As proof of this new concept, we designed an EEG-based virtual eye-tracker (EEG-VET) for tracking eye movement from EEG alone. The EEG-VET is composed of a SOBI algorithm for separating EEG signals into different components, a DANS algorithm for automatically identifying ocular components, and a linear model to transfer ocular components into gaze positions. Results: The prototype of EEG-VET achieved an accuracy of 0.920 degrees and precision of 1.510 degrees of a visual angle in the best participant, whereas an average accuracy of 1.008 degrees +/- 0.357 degrees and a precision of 2.348 degrees +/- 0.580 degrees of a visual angle across all participants (N = 18). Conclusion: This work offers a novel approach that readily co-registers eye movement and neural signals from a single-EEG recording, thus increasing the ease of studying neural mechanisms underlying natural cognition in the context of free eye movement.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Towards EEG-Based Haptic Interaction within Virtual Environments
    Tarng, Stanley
    Wang, Deng
    Hu, Yaoping
    Merienne, Frederic
    2019 26TH IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES (VR), 2019, : 1179 - 1180
  • [22] EEG-Based Emotion Recognition Datasets for Virtual Environments: A Survey
    Hamzah, Hussein Ali
    Abdalla, Kasim K.
    APPLIED COMPUTATIONAL INTELLIGENCE AND SOFT COMPUTING, 2024, 2024
  • [23] One step closer to EEG based eye tracking
    Fuhl, Wolfgang
    Zabel, Susanne
    Harbig, Theresa
    Moldt, Julia Astrid
    Wiete, Teresa Festl
    Werner, Anne Herrmann
    Nieselt, Kay
    ACM SYMPOSIUM ON EYE TRACKING RESEARCH & APPLICATIONS, ETRA 2023, 2023,
  • [24] IN THE TWINKLING OF AN EYE: SYNCHRONIZATION OF EEG AND EYE TRACKING BASED ON BLINK SIGNATURES
    Baekgaard, Per
    Petersen, Michael Kai
    Larsen, Jakob Eg
    2014 4TH INTERNATIONAL WORKSHOP ON COGNITIVE INFORMATION PROCESSING (CIP), 2014,
  • [25] EEG-based Spatial Navigation Estimation in a Virtual Reality Driving Environment
    Lin, Chin-Teng
    Yang, Fu-Shu
    Chiou, Te-Chung
    Ko, Li-Wei
    Duann, Jeng-Ren
    Gramann, Klaus
    2009 9TH IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOENGINEERING, 2009, : 435 - +
  • [26] Exploration of an EEG-Based Cognitively Adaptive Training System in Virtual Reality
    Dey, Arindam
    Chatburn, Alex
    Billinghurst, Mark
    2019 26TH IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES (VR), 2019, : 220 - 226
  • [27] Anasynchronously controlled EEG-based virtual keyboard:: Improvement of the spelling rate
    Scherer, R
    Müller, GR
    Neuper, C
    Graimann, B
    Pfurtscheller, G
    IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2004, 51 (06) : 979 - 984
  • [28] Quadcopter flight control using a low-cost hybrid interface with EEG-based classification and eye tracking
    Kim, Byung Hyung
    Kim, Minho
    Jo, Sungho
    COMPUTERS IN BIOLOGY AND MEDICINE, 2014, 51 : 82 - 92
  • [29] Exploring Gender Differences in EEG-based Emotion Recognition with Haptic Vibration
    Wang, Xin
    Xu, Baoguo
    Wang, Jiajin
    Zhang, Wenbin
    Song, Aiguo
    2023 IEEE INTERNATIONAL CONFERENCE ON DEVELOPMENT AND LEARNING, ICDL, 2023, : 22 - 27
  • [30] Exploring Day-to-Day Variability in EEG-based Emotion Classification
    Lin, Yuan-Pin
    Jung, Tzyy-Ping
    2014 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC), 2014, : 2226 - 2229