Real-world structure facilitates the rapid emergence of scene category information in visual brain signals

被引:12
|
作者
Kaiser, Daniel [1 ]
Haeberle, Greta [2 ,3 ,4 ]
Cichy, Radoslaw M. [2 ,3 ,4 ,5 ]
机构
[1] Univ York, Dept Psychol, York, N Yorkshire, England
[2] Free Univ Berlin, Dept Educ & Psychol, Berlin, Germany
[3] Charite Univ Med Berlin, Einstein Ctr Neurosci Berlin, Berlin, Germany
[4] Humboldt Univ, Berlin Sch Mind & Brain, Berlin, Germany
[5] Bernstein Ctr Computat Neurosci Berlin, Berlin, Germany
基金
欧洲研究理事会;
关键词
EEG; multivariate pattern analysis; real-world structure; scene representation; visual processing; REPRESENTATIONS; OBJECTS; PERCEPTION; FACES;
D O I
10.1152/jn.00164.2020
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
In everyday life, our visual surroundings are not arranged randomly but structured in predictable ways. Although previous studies have shown that the visual system is sensitive to such structural regularities, it remains unclear whether the presence of an intact structure in a scene also facilitates the cortical analysis of the scene's categorical content. To address this question, we conducted an EEG experiment during which participants viewed natural scene images that were either "intact" (with their quadrants arranged in typical positions) or "jumbled" (with their quadrants arranged into atypical positions). We then used multivariate pattern analysis to decode the scenes' category from the EEG signals (e.g., whether the participant had seen a church or a supermarket). The category of intact scenes could be decoded rapidly within the first 100 ms of visual processing. Critically, within 200 ms of processing, category decoding was more pronounced for the intact scenes compared with the jumbled scenes, suggesting that the presence of real-world structure facilitates the extraction of scene category information. No such effect was found when the scenes were presented upside down, indicating that the facilitation of neural category information is indeed linked to a scene's adherence to typical real-world structure rather than to differences in visual features between intact and jumbled scenes. Our results demonstrate that early stages of categorical analysis in the visual system exhibit tuning to the structure of the world that may facilitate the rapid extraction of behaviorally relevant information from rich natural environments. NEW & NOTEWORTHY Natural scenes are structured, with different types of information appearing in predictable locations. Here, we use EEG decoding to show that the visual brain uses this structure to efficiently analyze scene content. During early visual processing, the category of a scene (e.g., a church vs. a supermarket) could be more accurately decoded from EEG signals when the scene adhered to its typical spatial structure compared with when it did not.
引用
收藏
页码:145 / 151
页数:7
相关论文
共 41 条
  • [21] Flicker Augmentations: Rapid Brightness Modulation for Real-World Visual Guidance using Augmented Reality
    Sutton, Jonathan
    Langlotz, Tobias
    Plopski, Alexander
    Hornbaek, Kasper
    PROCEEDINGS OF THE 2024 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYTEMS, CHI 2024, 2024,
  • [22] Real-World Scene Representations in High-Level Visual Cortex: It's the Spaces More Than the Places
    Kravitz, Dwight J.
    Peng, Cynthia S.
    Baker, Chris I.
    JOURNAL OF NEUROSCIENCE, 2011, 31 (20): : 7322 - 7333
  • [23] Which factor affects the storage of real-world object information in visual working memory: perceptual or conceptual information?
    Li, Qiankai
    Chen, Zhen
    Sun, Qi
    Li, Xinyu
    FRONTIERS IN PSYCHOLOGY, 2023, 14
  • [24] Predictive traffic engineering incorporating real-world information inspired by the cognitive process of the human brain
    Satake, Kodai
    Ohsita, Yuichi
    Murata, Masayuki
    2019 10TH INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY CONVERGENCE (ICTC): ICT CONVERGENCE LEADING THE AUTONOMOUS FUTURE, 2019, : 543 - 548
  • [25] A model-based real-world scene recognition using local/global search of a GA for manipulator real-time visual servoing
    Agbanhan, J
    Minami, M
    Asakura, T
    IECON 2000: 26TH ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY, VOLS 1-4: 21ST CENTURY TECHNOLOGIES AND INDUSTRIAL OPPORTUNITIES, 2000, : 2195 - 2200
  • [26] From lab to life: assessing the impact of real-world interactions on the operation of rapid serial visual presentation-based brain-computer interfaces
    Awais, Muhammad Ahsan
    Ward, Tomas
    Redmond, Peter
    Healy, Graham
    JOURNAL OF NEURAL ENGINEERING, 2024, 21 (04)
  • [27] MARKET-STRUCTURE AND INCOMPLETE INFORMATION - PRICE FORMATION IN A REAL-WORLD REPEATED ENGLISH AUCTION
    NELSON, JP
    JOURNAL OF ECONOMIC BEHAVIOR & ORGANIZATION, 1995, 27 (03) : 421 - 437
  • [28] Empower Real-World BCIs with NIRS-X: An Adaptive Learning Framework that Harnesses Unlabeled Brain Signals
    Wang, Liang
    Zhang, Jiayan
    Liu, Jinyang
    McKeon, Devon
    Brizan, David Guy
    Blaney, Giles
    Jacob, Robert J. K.
    PROCEEDINGS OF THE 37TH ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE AND TECHNOLOGY, USIT 2024, 2024,
  • [29] A real-time music-scene-description system: predominant-FO estimation for detecting melody and bass lines in real-world audio signals
    Goto, M
    SPEECH COMMUNICATION, 2004, 43 (04) : 311 - 329
  • [30] An Information-Theoretic Approach on Causal Structure Learning for Heterogeneous Data Characteristics of Real-World Scenarios
    Huegle, Johannes
    PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 4891 - 4892