Semantic Grounding of Novel Spoken Words in the Primary Visual Cortex

被引:2
|
作者
Garagnani, Max [1 ,2 ]
Kirilina, Evgeniya [3 ,4 ]
Pulvermuller, Friedemann [2 ,5 ,6 ,7 ]
机构
[1] Goldsmiths Univ London, Dept Comp, London, England
[2] Free Univ Berlin, Brain Language Lab, Dept Philosophy & Humanities, WE4, Berlin, Germany
[3] Free Univ Berlin, Neurocomputat Neuroimaging Unit, Berlin, Germany
[4] Max Plank Inst Cognit & Brain Sci, Dept Neurophys, Leipzig, Germany
[5] Humboldt Univ, Berlin Sch Mind & Brain, Berlin, Germany
[6] Einstein Ctr Neurosci Berlin, Berlin, Germany
[7] Humboldt Univ, Cluster Excellence Matters Act, Berlin, Germany
来源
基金
英国工程与自然科学研究理事会; 英国生物技术与生命科学研究理事会; 欧洲研究理事会;
关键词
embodied cognition; word learning; language acquisition; action-perception circuit; conceptual category; CONCEPTUAL REPRESENTATIONS; LEXICAL COMPETITION; HUMAN BRAIN; LANGUAGE; CONSOLIDATION; RECOGNITION; SYSTEMS; ACQUISITION; PERCEPTION; OBJECT;
D O I
10.3389/fnhum.2021.581847
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Embodied theories of grounded semantics postulate that, when word meaning is first acquired, a link is established between symbol (word form) and corresponding semantic information present in modality-specific-including primary-sensorimotor cortices of the brain. Direct experimental evidence documenting the emergence of such a link (i.e., showing that presentation of a previously unknown, meaningless word sound induces, after learning, category-specific reactivation of relevant primary sensory or motor brain areas), however, is still missing. Here, we present new neuroimaging results that provide such evidence. We taught participants aspects of the referential meaning of previously unknown, senseless novel spoken words (such as "Shruba" or "Flipe") by associating them with either a familiar action or a familiar object. After training, we used functional magnetic resonance imaging to analyze the participants' brain responses to the new speech items. We found that hearing the newly learnt object-related word sounds selectively triggered activity in the primary visual cortex, as well as secondary and higher visual areas.These results for the first time directly document the formation of a link between the novel, previously meaningless spoken items and corresponding semantic information in primary sensory areas in a category-specific manner, providing experimental support for perceptual accounts of word-meaning acquisition in the brain.
引用
收藏
页数:16
相关论文
共 50 条
  • [31] Joint Discriminative Decoding of Words and Semantic Tags for Spoken Language Understanding
    Deoras, Anoop
    Tur, Gokhan
    Sarikaya, Ruhi
    Hakkani-Tuer, Dilek
    IEEE TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2013, 21 (08): : 1612 - 1621
  • [32] Visual mismatch negativity elicited by semantic violations in visual words
    Hu, Axu
    Gu, Feng
    Wong, Lena L. N.
    Tong, Xiuli
    Zhang, Xiaochu
    BRAIN RESEARCH, 2020, 1746
  • [33] VISUAL SIMILARITY AND SEMANTIC ACTIVATION BY PICTURES AND WORDS
    SIPLE, P
    WALLS, WF
    MILLER, C
    BULLETIN OF THE PSYCHONOMIC SOCIETY, 1985, 23 (04) : 295 - 295
  • [34] Discriminating Semantic Visual Words for Scene Classification
    Liu, Shuoyan
    Xu, De
    Feng, Songhe
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2010, E93D (06) : 1580 - 1588
  • [35] The role of visual representations during the lexical access of spoken words
    Lewis, Gwyneth
    Poeppel, David
    BRAIN AND LANGUAGE, 2014, 134 : 1 - 10
  • [36] NATURE OF CONTROL BY SPOKEN WORDS OVER VISUAL STIMULUS SELECTION
    DIXON, LS
    JOURNAL OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR, 1977, 27 (03) : 433 - 442
  • [37] Primary visual cortex and visual awareness
    Frank Tong
    Nature Reviews Neuroscience, 2003, 4 : 219 - 229
  • [38] Primary visual cortex and visual awareness
    Tong, F
    NATURE REVIEWS NEUROSCIENCE, 2003, 4 (03) : 219 - 229
  • [39] Semantic Image Retrieval via Active Grounding of Visual Situations
    Quinn, Max H.
    Conser, Erik
    Witte, Jordan M.
    Mitchell, Melanie
    2018 IEEE 12TH INTERNATIONAL CONFERENCE ON SEMANTIC COMPUTING (ICSC), 2018, : 172 - 179
  • [40] Learning Fine-grained Semantics in Spoken Language Using Visual Grounding
    Wang, Xinsheng
    Tian, Tian
    Zhu, Jihua
    Scharenborg, Odette
    2021 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2021,