Tracking gaze position from EEG: Exploring the possibility of an EEG-based virtual eye-tracker

被引:1
|
作者
Sun, Rui [1 ,3 ]
Cheng, Andy S. K. [1 ]
Chan, Cynthia [2 ]
Hsiao, Janet [2 ]
Privitera, Adam J. [7 ]
Gao, Junling [4 ]
Fong, Ching-hang [1 ]
Ding, Ruoxi [5 ]
Tang, Akaysha C. [3 ,6 ,8 ]
机构
[1] Hong Kong Polytech Univ, Dept Rehabil Sci, Hong Kong, Peoples R China
[2] Univ Hong Kong, Dept Psychol, Hong Kong, Peoples R China
[3] Univ Hong Kong, Lab Neurosci Educ, Hong Kong, Peoples R China
[4] Univ Hong Kong, Ctr Buddhism Studies, Hong Kong, Peoples R China
[5] Peking Univ, China Ctr Hlth Dev Studies, Beijing, Peoples R China
[6] Neural Dialogue, Shenzhen, Peoples R China
[7] Nanyang Technol Univ, Ctr Res & Dev Learning, Singapore, Singapore
[8] Neural Dialogue, Suite E 2213, 16 Hongshang Rd, Shenzhen 518110, Peoples R China
来源
BRAIN AND BEHAVIOR | 2023年 / 13卷 / 10期
关键词
BSS; eye movement; high-density EEG; ICA; saccade; SOBI; smooth pursuit; BLIND SOURCE SEPARATION; INDEPENDENT COMPONENTS; ARTIFACT ELIMINATION; AUTOMATIC REMOVAL; OCULAR ARTIFACTS; COMBINING EEG; MOVEMENT; IDENTIFICATION; ELECTROENCEPHALOGRAM; SIGNALS;
D O I
10.1002/brb3.3205
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
Introduction: Ocular artifact has long been viewed as an impediment to the interpretation of electroencephalogram (EEG) signals in basic and applied research. Today, the use of blind source separation (BSS) methods, including independent component analysis (ICA) and second-order blind identification (SOBI), is considered an essential step in improving the quality of neural signals. Recently, we introduced amethod consisting of SOBI and a discriminant and similarity (DANS)-based identification method, capable of identifying and extracting eye movement-related components. These recovered components can be localized within ocular structures with a high goodness of fit (>95%). This raised the possibility that such EEG-derived SOBI components may be used to build predictive models for tracking gaze position. Methods: As proof of this new concept, we designed an EEG-based virtual eye-tracker (EEG-VET) for tracking eye movement from EEG alone. The EEG-VET is composed of a SOBI algorithm for separating EEG signals into different components, a DANS algorithm for automatically identifying ocular components, and a linear model to transfer ocular components into gaze positions. Results: The prototype of EEG-VET achieved an accuracy of 0.920 degrees and precision of 1.510 degrees of a visual angle in the best participant, whereas an average accuracy of 1.008 degrees +/- 0.357 degrees and a precision of 2.348 degrees +/- 0.580 degrees of a visual angle across all participants (N = 18). Conclusion: This work offers a novel approach that readily co-registers eye movement and neural signals from a single-EEG recording, thus increasing the ease of studying neural mechanisms underlying natural cognition in the context of free eye movement.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Review of Studies on User Research Based on EEG and Eye Tracking
    Zhu, Ling
    Lv, Jiufang
    APPLIED SCIENCES-BASEL, 2023, 13 (11):
  • [32] EEG and Eye-Tracking Based Measures for Enhanced Training
    Soussou, Walid
    Rooksby, Michael
    Forty, Charles
    Weatherhead, James
    Marshall, Sandra
    2012 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2012, : 1623 - 1626
  • [33] Reading comprehension based on visualization of eye tracking and EEG data
    Cheng, Shiwei
    Hu, Yilin
    Fan, Jing
    Wei, Qianjing
    SCIENCE CHINA-INFORMATION SCIENCES, 2020, 63 (11)
  • [34] Reading comprehension based on visualization of eye tracking and EEG data
    Shiwei Cheng
    Yilin Hu
    Jing Fan
    Qianjing Wei
    Science China Information Sciences, 2020, 63
  • [35] Reading comprehension based on visualization of eye tracking and EEG data
    Shiwei CHENG
    Yilin HU
    Jing FAN
    Qianjing WEI
    ScienceChina(InformationSciences), 2020, 63 (11) : 276 - 289
  • [36] EEG-based Cadets Training and Performance Assessment System in Maritime Virtual Simulator
    Liu, Yisi
    Lan, Zirui
    Sourina, Olga
    Liew, Hui Ping
    Krishnan, Gopala
    Konovessis, Dimitrios
    Ang, Hock Eng
    2018 INTERNATIONAL CONFERENCE ON CYBERWORLDS (CW), 2018, : 214 - 220
  • [37] EEG-Based Identification of Emotional Neural State Evoked by Virtual Environment Interaction
    Jung, Dawoon
    Choi, Junggu
    Kim, Jeongjae
    Cho, Seoyoung
    Han, Sanghoon
    INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH, 2022, 19 (04)
  • [38] A Review of Deep Learning Approaches to EEG-Based Classification of Cybersickness in Virtual Reality
    Yildirim, Caglar
    2020 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND VIRTUAL REALITY (AIVR 2020), 2020, : 351 - 357
  • [39] How Human Am I? EEG-based Evaluation of Animated Virtual Characters
    Mustafa, Maryam
    Guthe, Stefan
    Tauscher, Jan-Philipp
    Goesele, Michael
    Magnor, Marcus
    PROCEEDINGS OF THE 2017 ACM SIGCHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI'17), 2017, : 5098 - 5108
  • [40] EEG-based emotion estimation using adaptive tracking of discriminative frequency components
    Liu, Shuang
    Zhang, Di
    Tong, Jingjing
    He, Feng
    Qi, Hongzhi
    Zhang, Lixin
    Ming, Dong
    2017 39TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2017, : 2231 - 2234