Semantic Grounding of Novel Spoken Words in the Primary Visual Cortex

被引:2
|
作者
Garagnani, Max [1 ,2 ]
Kirilina, Evgeniya [3 ,4 ]
Pulvermuller, Friedemann [2 ,5 ,6 ,7 ]
机构
[1] Goldsmiths Univ London, Dept Comp, London, England
[2] Free Univ Berlin, Brain Language Lab, Dept Philosophy & Humanities, WE4, Berlin, Germany
[3] Free Univ Berlin, Neurocomputat Neuroimaging Unit, Berlin, Germany
[4] Max Plank Inst Cognit & Brain Sci, Dept Neurophys, Leipzig, Germany
[5] Humboldt Univ, Berlin Sch Mind & Brain, Berlin, Germany
[6] Einstein Ctr Neurosci Berlin, Berlin, Germany
[7] Humboldt Univ, Cluster Excellence Matters Act, Berlin, Germany
来源
基金
英国工程与自然科学研究理事会; 英国生物技术与生命科学研究理事会; 欧洲研究理事会;
关键词
embodied cognition; word learning; language acquisition; action-perception circuit; conceptual category; CONCEPTUAL REPRESENTATIONS; LEXICAL COMPETITION; HUMAN BRAIN; LANGUAGE; CONSOLIDATION; RECOGNITION; SYSTEMS; ACQUISITION; PERCEPTION; OBJECT;
D O I
10.3389/fnhum.2021.581847
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Embodied theories of grounded semantics postulate that, when word meaning is first acquired, a link is established between symbol (word form) and corresponding semantic information present in modality-specific-including primary-sensorimotor cortices of the brain. Direct experimental evidence documenting the emergence of such a link (i.e., showing that presentation of a previously unknown, meaningless word sound induces, after learning, category-specific reactivation of relevant primary sensory or motor brain areas), however, is still missing. Here, we present new neuroimaging results that provide such evidence. We taught participants aspects of the referential meaning of previously unknown, senseless novel spoken words (such as "Shruba" or "Flipe") by associating them with either a familiar action or a familiar object. After training, we used functional magnetic resonance imaging to analyze the participants' brain responses to the new speech items. We found that hearing the newly learnt object-related word sounds selectively triggered activity in the primary visual cortex, as well as secondary and higher visual areas.These results for the first time directly document the formation of a link between the novel, previously meaningless spoken items and corresponding semantic information in primary sensory areas in a category-specific manner, providing experimental support for perceptual accounts of word-meaning acquisition in the brain.
引用
收藏
页数:16
相关论文
共 50 条
  • [21] A Dual Contribution to the Involuntary Semantic Processing of Unexpected Spoken Words
    Parmentier, Fabrice B. R.
    Turner, Jacqueline
    Perez, Laura
    JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL, 2014, 143 (01) : 38 - 45
  • [22] Effects of Auditory and Visual Priming on the Identification of Spoken Words
    Shigeno, Sumi
    PERCEPTUAL AND MOTOR SKILLS, 2017, 124 (02) : 549 - 563
  • [23] Grounding Novel Words Into Emotion: ERP Investigation
    Bermudez-Margaretto, Beatriz
    Myachykov, Andriy
    Beltran, David
    Kopytin, Grigory
    Rahimckulova, Aliia
    Shtyrov, Yury
    INTERNATIONAL JOURNAL OF PSYCHOPHYSIOLOGY, 2021, 168 : S153 - S153
  • [24] A Sensorimotor Perspective on Grounding the Semantic of Simple Visual Features
    Laflaquiere, Alban
    2018 JOINT IEEE 8TH INTERNATIONAL CONFERENCE ON DEVELOPMENT AND LEARNING AND EPIGENETIC ROBOTICS (ICDL-EPIROB), 2018, : 60 - 65
  • [25] Weakly-Supervised Spoken Video Grounding via Semantic Interaction Learning
    Wang, Ye
    Lin, Wang
    Zhang, Shengyu
    Jin, Tao
    Li, Linjun
    Cheng, Xize
    Zhao, Zhou
    PROCEEDINGS OF THE 61ST ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2023): LONG PAPERS, VOL 1, 2023, : 10914 - 10932
  • [26] Words Spoken Daily: A Novel Measure of Cognition
    Lettenberger, S.
    Zafar, M.
    Soto, J.
    Zhang, Y.
    Zhu, G.
    Masino, A.
    Nkrumah, G.
    Waddell, E.
    Spear, K.
    Arky, A.
    Toor, R.
    Hartman, E.
    Epifano, J.
    Christie, R.
    Duan, Z.
    Dorsey, R.
    MOVEMENT DISORDERS, 2023, 38 : S783 - S783
  • [27] The Time-Course of the Cross-Modal Semantic Modulation of Visual Picture Processing by Naturalistic Sounds and Spoken Words
    Chen, Yi-Chuan
    Spence, Charles
    MULTISENSORY RESEARCH, 2013, 26 (04) : 371 - 386
  • [28] Semantic retrieval of spoken words with an obliterated initial phoneme in a sentence context
    Sivonen, Paivi
    Maess, Burkhard
    Friederici, Angela D.
    NEUROSCIENCE LETTERS, 2006, 408 (03) : 220 - 225
  • [29] Semantic processing of spoken words in Alzheimer's disease: An electrophysiological study
    Revonsuo, A
    Portin, R
    Juottonen, K
    Rinne, JO
    JOURNAL OF COGNITIVE NEUROSCIENCE, 1998, 10 (03) : 408 - 420
  • [30] "Visual" Cortex Responds to Spoken Language in Blind Children
    Bedny, Marina
    Richardson, Hilary
    Saxe, Rebecca
    JOURNAL OF NEUROSCIENCE, 2015, 35 (33): : 11674 - 11681