How are visual words represented? Insights from EEG-based visual word decoding, feature derivation and image reconstruction

被引:10
|
作者
Ling, Shouyu [1 ]
Lee, Andy C. H. [1 ,2 ]
Armstrong, Blair C. [1 ,3 ]
Nestor, Adrian [1 ]
机构
[1] Univ Toronto, Dept Psychol Scarborough, Toronto, ON, Canada
[2] Baycrest Ctr Geriatr Care, Rotman Res Inst, Toronto, ON, Canada
[3] Basque Ctr Cognit Brain & Language, BCBL, San Sebastian, Spain
基金
加拿大自然科学与工程研究理事会;
关键词
EEG; multivariate analysis; reading; word processing; TIME-COURSE; BRAIN ACTIVATION; FORM AREA; RECOGNITION; ERP; PATTERNS; IMPACT;
D O I
10.1002/hbm.24757
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Investigations into the neural basis of reading have shed light on the cortical locus and the functional role of visual-orthographic processing. Yet, the fine-grained structure of neural representations subserving reading remains to be clarified. Here, we capitalize on the spatiotemporal structure of electroencephalography (EEG) data to examine if and how EEG patterns can serve to decode and reconstruct the internal representation of visually presented words in healthy adults. Our results show that word classification and image reconstruction were accurate well above chance, that their temporal profile exhibited an early onset, soon after 100 ms, and peaked around 170 ms. Further, reconstruction results were well explained by a combination of visual-orthographic word properties. Last, systematic individual differences were detected in orthographic representations across participants. Collectively, our results establish the feasibility of EEG-based word decoding and image reconstruction. More generally, they help to elucidate the specific features, dynamics, and neurocomputational principles underlying word recognition.
引用
收藏
页码:5056 / 5068
页数:13
相关论文
共 30 条
  • [21] Decoding Visual Recognition of Objects from EEG Signals based on Attention-Driven Convolutional Neural Network
    Kalafatovich, Jenifer
    Lee, Minji
    Lee, Seong-Whan
    2020 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2020, : 2985 - 2990
  • [22] A Novel Framework for Extracting Visual Feature-Based Keyword Relationships from an Image Database
    Katsurai, Marie
    Ogawa, Takahiro
    Haseyama, Miki
    IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2012, E95A (05) : 927 - 937
  • [23] Semantics-Guided Hierarchical Feature Encoding Generative Adversarial Network for Visual Image Reconstruction From Brain Activity
    Meng, Lu
    Yang, Chuanhao
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2024, 32 : 1267 - 1283
  • [24] Breast Cancer: Model Reconstruction and Image Registration From Segmented Deformed Image Using Visual and Force Based Analysis
    Rana, Shuvendu
    Hampson, Rory
    Dobie, Gordon
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (05) : 1295 - 1305
  • [25] HOW THE DORSOLATERAL PREFRONTAL CORTEX CONTROLS AFFECTIVE PROCESSING IN ABSENCE OF VISUAL AWARENESS - INSIGHTS FROM A COMBINED EEG-RTMS STUDY
    Terrighena, Esslin
    Keuper, Kati
    Chan, Chetwyn
    Junghofer, Markus
    Lee, Tatia
    PSYCHOPHYSIOLOGY, 2017, 54 : S47 - S47
  • [26] How the Dorsolateral Prefrontal Cortex Controls Affective Processing in Absence of Visual Awareness - Insights From a Combined EEG-rTMS Study
    Keuper, Kati
    Terrighena, Esslin L.
    Chan, Chetwyn C. H.
    Junghoefer, Markus
    Lee, Tatia M. C.
    FRONTIERS IN HUMAN NEUROSCIENCE, 2018, 12
  • [27] Efficient pretraining model based on multi-scale local visual field feature reconstruction for PCB CT image element segmentation
    Chen, Chen
    Qiao, Kai
    Yang, Jie
    Chen, Jian
    Yan, Bin
    APPLIED OPTICS, 2024, 63 (30) : 7982 - 7989
  • [28] Anti-deception: reliable EEG-based biometrics with real-time capability from the neural response of face rapid serial visual presentation
    Wu, Qunjian
    Yan, Bin
    Zeng, Ying
    Zhang, Chi
    Tong, Li
    BIOMEDICAL ENGINEERING ONLINE, 2018, 17
  • [29] Anti-deception: reliable EEG-based biometrics with real-time capability from the neural response of face rapid serial visual presentation
    Qunjian Wu
    Bin Yan
    Ying Zeng
    Chi Zhang
    Li Tong
    BioMedical Engineering OnLine, 17
  • [30] Bit-Wise Reconstruction of Non-binary Visual Stimulation Patterns from EEG Using Deep Learning: A Promising Alternative for User-Friendly High-Speed c-VEP-Based BCIs
    Santamaria-Vazquez, Eduardo
    Martinez-Cagigal, Victor
    Hornero, Roberto
    ADVANCES IN COMPUTATIONAL INTELLIGENCE, IWANN 2023, PT II, 2023, 14135 : 603 - 614