Mid-level visual features underlie the high-level categorical organization of the ventral stream

被引:136
|
作者
Long, Bria [1 ,2 ]
Yu, Chen-Ping [1 ,3 ]
Konkle, Talia [1 ]
机构
[1] Harvard Univ, Dept Psychol, 33 Kirkland St, Cambridge, MA 02138 USA
[2] Stanford Univ, Dept Psychol, Stanford, CA 94305 USA
[3] Phiar Technol Inc, Palo Alto, CA 94303 USA
关键词
ventral stream organization; mid-level features; object recognition; fMRI; deep neural networks; FUSIFORM FACE AREA; NEURAL REPRESENTATIONS; CONGENITALLY BLIND; TEMPORAL CORTEX; OBJECT CATEGORY; SHAPE; SELECTIVITY; SIZE; PERCEPTION; SIMILARITY;
D O I
10.1073/pnas.1719616115
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Human object-selective cortex shows a large-scale organization characterized by the high-level properties of both animacy and object size. To what extent are these neural responses explained by primitive perceptual features that distinguish animals from objects and big objects from small objects? To address this question, we used a texture synthesis algorithm to create a class of stimuli-texforms-which preserve some mid-level texture and form information from objects while rendering them unrecognizable. We found that unrecognizable texforms were sufficient to elicit the large-scale organizations of object-selective cortex along the entire ventral pathway. Further, the structure in the neural patterns elicited by texforms was well predicted by curvature features and by intermediate layers of a deep convolutional neural network, supporting the mid-level nature of the representations. These results provide clear evidence that a substantial portion of ventral stream organization can be accounted for by coarse texture and form information without requiring explicit recognition of intact objects.
引用
收藏
页码:E9015 / E9024
页数:10
相关论文
共 50 条
  • [1] Mid-level workers: high-level bungling?
    不详
    SAMJ SOUTH AFRICAN MEDICAL JOURNAL, 2007, 97 (03): : 148 - 148
  • [2] Mid-level workers: high-level bungling?
    van Niekerk, J. P. de V.
    SAMJ SOUTH AFRICAN MEDICAL JOURNAL, 2006, 96 (12): : 1209 - +
  • [3] Luminance and color inputs to mid-level and high-level vision
    Jennings, Ben J.
    Martinovic, Jasna
    JOURNAL OF VISION, 2014, 14 (02): : 1 - 17
  • [4] Learning Mid-Level Features For Recognition
    Boureau, Y-Lan
    Bach, Francis
    LeCun, Yann
    Ponce, Jean
    2010 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2010, : 2559 - 2566
  • [5] High-level concept detection based on mid-level semantic information and contextual adaptation
    Mylonas, Phivos
    Spyrou, Evaggelos
    Avrithis, Yannis
    SECOND INTERNATIONAL WORKSHOP ON SEMANTIC MEDIA ADAPTATION AND PERSONALIZATION, PROCEEDINGS, 2007, : 193 - 198
  • [6] Ensemble representation of animacy could be based on mid-level visual features
    Tiurina, Natalia A.
    Markov, Yuri A.
    ATTENTION PERCEPTION & PSYCHOPHYSICS, 2025, 87 (02) : 415 - 430
  • [7] Object shape and surface properties are jointly encoded in mid-level ventral visual cortex
    Pasupathy, Anitha
    Kim, Taekjun
    Popovkina, Dina V.
    CURRENT OPINION IN NEUROBIOLOGY, 2019, 58 : 199 - 208
  • [8] Unsupervised learning of mid-level visual representations
    Matteucci, Giulio
    Piasini, Eugenio
    Zoccolan, Davide
    CURRENT OPINION IN NEUROBIOLOGY, 2024, 84
  • [9] Mining Mid-level Features for Image Classification
    Basura Fernando
    Elisa Fromont
    Tinne Tuytelaars
    International Journal of Computer Vision, 2014, 108 : 186 - 203
  • [10] Visual Forecasting as a Mid-level Representation for Avoidance
    Yang, Hsuan-Kung
    Chiang, Tsung-Chih
    Liu, Ting-Ru
    Huang, Chun-Wei
    Liu, Jou-Min
    Lee, Chun-Yi
    2024 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, IROS 2024, 2024, : 5481 - 5488