Mid-level visual features underlie the high-level categorical organization of the ventral stream

被引:136
|
作者
Long, Bria [1 ,2 ]
Yu, Chen-Ping [1 ,3 ]
Konkle, Talia [1 ]
机构
[1] Harvard Univ, Dept Psychol, 33 Kirkland St, Cambridge, MA 02138 USA
[2] Stanford Univ, Dept Psychol, Stanford, CA 94305 USA
[3] Phiar Technol Inc, Palo Alto, CA 94303 USA
关键词
ventral stream organization; mid-level features; object recognition; fMRI; deep neural networks; FUSIFORM FACE AREA; NEURAL REPRESENTATIONS; CONGENITALLY BLIND; TEMPORAL CORTEX; OBJECT CATEGORY; SHAPE; SELECTIVITY; SIZE; PERCEPTION; SIMILARITY;
D O I
10.1073/pnas.1719616115
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Human object-selective cortex shows a large-scale organization characterized by the high-level properties of both animacy and object size. To what extent are these neural responses explained by primitive perceptual features that distinguish animals from objects and big objects from small objects? To address this question, we used a texture synthesis algorithm to create a class of stimuli-texforms-which preserve some mid-level texture and form information from objects while rendering them unrecognizable. We found that unrecognizable texforms were sufficient to elicit the large-scale organizations of object-selective cortex along the entire ventral pathway. Further, the structure in the neural patterns elicited by texforms was well predicted by curvature features and by intermediate layers of a deep convolutional neural network, supporting the mid-level nature of the representations. These results provide clear evidence that a substantial portion of ventral stream organization can be accounted for by coarse texture and form information without requiring explicit recognition of intact objects.
引用
收藏
页码:E9015 / E9024
页数:10
相关论文
共 50 条
  • [31] Discovering and Aligning Discriminative Mid-Level Features for Image Classification
    Sicre, Ronan
    Jurie, Frederic
    2014 22ND INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2014, : 1975 - 1980
  • [32] Mid-level convection in a warm conveyor belt accelerates the jet stream
    Blanchard, Nicolas
    Pantillon, Florian
    Chaboureau, Jean-Pierre
    Delanoe, Julien
    WEATHER AND CLIMATE DYNAMICS, 2021, 2 (01): : 37 - 53
  • [33] Mining Mid-level Visual Patterns with Deep CNN Activations
    Yao Li
    Lingqiao Liu
    Chunhua Shen
    Anton van den Hengel
    International Journal of Computer Vision, 2017, 121 : 344 - 364
  • [34] Mid-level Features for Categorization of Social Interactions in Public Spaces
    Zitouni, M. Sami
    Sluzek, Andrzej
    16TH IEEE INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS AND VISION (ICARCV 2020), 2020, : 1150 - 1155
  • [35] Mid-level perceptual features contain early cues to animacy
    Long, Bria
    Stormer, Viola S.
    Alvarez, George A.
    JOURNAL OF VISION, 2017, 17 (06):
  • [36] MID-LEVEL CHORD TRANSITION FEATURES FOR MUSICAL STYLE ANALYSIS
    Weiss, Christof
    Brand, Fabian
    Mueller, Meinard
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 341 - 345
  • [37] Image understanding systems based on the unifying representation of perceptual and conceptual information and the solution of mid-level and high-level vision problems
    Kuvychko, I
    INTELLIGENT ROBOTS AND COMPUTER VISION XX: ALGORITHMS, TECHNIQUES, AND ACTIVE VISION, 2001, 4572 : 247 - 258
  • [38] Application of Crus of Helix Incision Through the Posterior Parotid Gland Approach in the Mid-Level or High-Level Mandibular Condylar Fractures
    Liu, Xiang
    Shao, Shengjie
    Lou, Huiquan
    Xia, Yichao
    JOURNAL OF CRANIOFACIAL SURGERY, 2024, 35 (06) : 1844 - 1847
  • [39] A data driven approach to understanding the organization of high-level visual cortex
    David M. Watson
    Timothy J. Andrews
    Tom Hartley
    Scientific Reports, 7
  • [40] A data driven approach to understanding the organization of high-level visual cortex
    Watson, David M.
    Andrews, Timothy J.
    Hartley, Tom
    SCIENTIFIC REPORTS, 2017, 7