Semantic Grounding of Novel Spoken Words in the Primary Visual Cortex

被引:2
|
作者
Garagnani, Max [1 ,2 ]
Kirilina, Evgeniya [3 ,4 ]
Pulvermuller, Friedemann [2 ,5 ,6 ,7 ]
机构
[1] Goldsmiths Univ London, Dept Comp, London, England
[2] Free Univ Berlin, Brain Language Lab, Dept Philosophy & Humanities, WE4, Berlin, Germany
[3] Free Univ Berlin, Neurocomputat Neuroimaging Unit, Berlin, Germany
[4] Max Plank Inst Cognit & Brain Sci, Dept Neurophys, Leipzig, Germany
[5] Humboldt Univ, Berlin Sch Mind & Brain, Berlin, Germany
[6] Einstein Ctr Neurosci Berlin, Berlin, Germany
[7] Humboldt Univ, Cluster Excellence Matters Act, Berlin, Germany
来源
基金
英国工程与自然科学研究理事会; 英国生物技术与生命科学研究理事会; 欧洲研究理事会;
关键词
embodied cognition; word learning; language acquisition; action-perception circuit; conceptual category; CONCEPTUAL REPRESENTATIONS; LEXICAL COMPETITION; HUMAN BRAIN; LANGUAGE; CONSOLIDATION; RECOGNITION; SYSTEMS; ACQUISITION; PERCEPTION; OBJECT;
D O I
10.3389/fnhum.2021.581847
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Embodied theories of grounded semantics postulate that, when word meaning is first acquired, a link is established between symbol (word form) and corresponding semantic information present in modality-specific-including primary-sensorimotor cortices of the brain. Direct experimental evidence documenting the emergence of such a link (i.e., showing that presentation of a previously unknown, meaningless word sound induces, after learning, category-specific reactivation of relevant primary sensory or motor brain areas), however, is still missing. Here, we present new neuroimaging results that provide such evidence. We taught participants aspects of the referential meaning of previously unknown, senseless novel spoken words (such as "Shruba" or "Flipe") by associating them with either a familiar action or a familiar object. After training, we used functional magnetic resonance imaging to analyze the participants' brain responses to the new speech items. We found that hearing the newly learnt object-related word sounds selectively triggered activity in the primary visual cortex, as well as secondary and higher visual areas.These results for the first time directly document the formation of a link between the novel, previously meaningless spoken items and corresponding semantic information in primary sensory areas in a category-specific manner, providing experimental support for perceptual accounts of word-meaning acquisition in the brain.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Reverse sequencing syllables of spoken words activates primary visual cortex
    Ino, T
    Asada, T
    Hirose, S
    Ito, J
    Fukuyama, H
    NEUROREPORT, 2003, 14 (15) : 1895 - 1899
  • [2] Spoken language processing activates the primary visual cortex
    Seydell-Greenwald, Anna
    Wang, Xiaoying
    Newport, Elissa L.
    Bi, Yanchao
    Striem-Amit, Ella
    PLOS ONE, 2023, 18 (08):
  • [3] Crossmodal Semantic Priming by Naturalistic Sounds and Spoken Words Enhances Visual Sensitivity
    Chen, Yi-Chuan
    Spence, Charles
    JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE, 2011, 37 (05) : 1554 - 1568
  • [4] Task estimation using latent semantic analysis of visual scenes and spoken words
    Kimura, Masashi
    Sawada, Shinta
    Iribe, Yurie
    Katsurada, Kouichi
    Nitta, Tsuneo
    Kimura, M. (kimura@vox.cs.tut.ac.jp), 2012, Institute of Electrical Engineers of Japan (132) : 1473 - 1480
  • [5] Task Estimation Using Latent Semantic Analysis of Visual Scenes and Spoken Words
    Kimura, Masashi
    Sawada, Shinta
    Iribe, Yurie
    Katsurada, Kouichi
    Nitta, Tsuneo
    ELECTRONICS AND COMMUNICATIONS IN JAPAN, 2014, 97 (06) : 33 - 42
  • [6] Semantic richness: The role of semantic features in processing spoken words
    Sajin, Stanislav M.
    Connine, Cynthia M.
    JOURNAL OF MEMORY AND LANGUAGE, 2014, 70 : 13 - 35
  • [7] PRIMING THE VISUAL RECOGNITION OF SPOKEN WORDS
    LANSING, CR
    HELGESON, CL
    JOURNAL OF SPEECH AND HEARING RESEARCH, 1995, 38 (06): : 1377 - 1386
  • [8] Visual-Semantic Graph Matching for Visual Grounding
    Jing, Chenchen
    Wu, Yuwei
    Pei, Mingtao
    Hu, Yao
    Jia, Yunde
    Wu, Qi
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 4041 - 4050
  • [9] Interaction between episodic and semantic memory networks in the acquisition and consolidation of novel spoken words
    Takashima, Atsuko
    Bakker, Iske
    van Hell, Janet G.
    Janzen, Gabriele
    McQueen, James M.
    BRAIN AND LANGUAGE, 2017, 167 : 44 - 60
  • [10] PHONETIC-AND-SEMANTIC EMBEDDING OF SPOKEN WORDS WITH APPLICATIONS IN SPOKEN CONTENT RETRIEVAL
    Chen, Yi-Chen
    Huang, Sung-Feng
    Shen, Chia-Hao
    Lee, Hung-yi
    Lee, Lin-shan
    2018 IEEE WORKSHOP ON SPOKEN LANGUAGE TECHNOLOGY (SLT 2018), 2018, : 941 - 948