Neural source dynamics of brain responses to continuous stimuli: Speech processing from acoustics to comprehension

被引:79
|
作者
Brodbeck, Christian [1 ]
Presacco, Alessandro [2 ]
Simon, Jonathan Z. [1 ,3 ,4 ]
机构
[1] Univ Maryland, Syst Res Inst, College Pk, MD 20742 USA
[2] Univ Calif Irvine, Dept Otolaryngol, Irvine, CA USA
[3] Univ Maryland, Dept Elect & Comp Engn, College Pk, MD 20742 USA
[4] Univ Maryland, Dept Biol, College Pk, MD 20742 USA
基金
美国国家卫生研究院;
关键词
Magnetoencephalography; Minimum norm estimate; Speech representation; Impulse response; Temporal response function; Reverse correlation; AUDITORY WORD RECOGNITION; CORTICAL REPRESENTATION; MOTOR CORTEX; TIME-COURSE; MEG; FREQUENCY; LOCALIZATION; EEG; ORGANIZATION; REGIONS;
D O I
10.1016/j.neuroimage.2018.01.042
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Human experience often involves continuous sensory information that unfolds over time. This is true in particular for speech comprehension, where continuous acoustic signals are processed over seconds or even minutes. We show that brain responses to such continuous stimuli can be investigated in detail, for magnetoencephalography (MEG) data, by combining linear kernel estimation with minimum norm source localization. Previous research has shown that the requirement to average data over many trials can be overcome by modeling the brain response as a linear convolution of the stimulus and a kernel, or response function, and estimating a kernel that predicts the response from the stimulus. However, such analysis has been typically restricted to sensor space. Here we demonstrate that this analysis can also be performed in neural source space. We first computed distributed minimum norm current source estimates for continuous MEG recordings, and then computed response functions for the current estimate at each source element, using the boosting algorithm with cross-validation. Permutation tests can then assess the significance of individual predictor variables, as well as features of the corresponding spatio-temporal response functions. We demonstrate the viability of this technique by computing spatio-temporal response functions for speech stimuli, using predictor variables reflecting acoustic, lexical and semantic processing. Results indicate that processes related to comprehension of continuous speech can be differentiated anatomically as well as temporally: acoustic information engaged auditory cortex at short latencies, followed by responses over the central sulcus and inferior frontal gyrus, possibly related to somatosensory/motor cortex involvement in speech perception; lexical frequency was associated with a left-lateralized response in auditory cortex and subsequent bilateral frontal activity; and semantic composition was associated with bilateral temporal and frontal brain activity. We conclude that this technique can be used to study the neural processing of continuous stimuli in time and anatomical space with the millisecond temporal resolution of MEG. This suggests new avenues for analyzing neural processing of naturalistic stimuli, without the necessity of averaging over artificially short or truncated stimuli.
引用
收藏
页码:162 / 174
页数:13
相关论文
共 50 条
  • [1] The neural processing of the acoustics properties of speech
    Scott, S
    Rosen, S
    Conway, L
    Chadha, S
    Wise, R
    JOURNAL OF PSYCHOPHYSIOLOGY, 2005, 19 (01) : 65 - 65
  • [2] Discrimination of Speech Stimuli Based on Neuronal Response Phase Patterns Depends on Acoustics But Not Comprehension
    Howard, Mary F.
    Poeppel, David
    JOURNAL OF NEUROPHYSIOLOGY, 2010, 104 (05) : 2500 - 2511
  • [3] Neural Markers of Speech Comprehension: Measuring EEG Tracking of Linguistic Speech Representations, Controlling the Speech Acoustics
    Gillis, Marlies
    Vanthornhout, Jonas
    Simon, Jonathan Z.
    Francart, Tom
    Brodbeck, Christian
    JOURNAL OF NEUROSCIENCE, 2021, 41 (50): : 10316 - 10329
  • [4] Decoding stimuli from multi-source neural responses
    Li, Lin
    Choi, John S.
    Francis, Joseph T.
    Sanchez, Justin C.
    Principe, Jose C.
    2012 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2012, : 1331 - 1334
  • [5] BRAIN RESPONSES TO STIMULI IN DISORDERS OF INFORMATION PROCESSING
    SHIELDS, DT
    JOURNAL OF LEARNING DISABILITIES, 1973, 6 (08) : 501 - 505
  • [6] The neural processing of pitch accents in continuous speech
    Llanos, Fernando
    German, James S.
    Gnanateja, G. Nike
    Chandrasekaran, Bharath
    NEUROPSYCHOLOGIA, 2021, 158
  • [7] Neural tracking of continuous acoustics: properties, speech-specificity and open questions
    Zoefel, Benedikt
    Kosem, Anne
    EUROPEAN JOURNAL OF NEUROSCIENCE, 2024, 59 (03) : 394 - 414
  • [8] From sound to meaning: Hierarchical processing in speech comprehension
    Johnsrude, I
    Davis, M
    Hervais-Adelman, A
    AUDITORY SIGNAL PROCESSINGP: PHYSIOLOGY, PSYCHOACOUSTICS, AND MODELS, 2005, : 299 - 306
  • [9] Neural Dynamics of Speech Act Comprehension: An MEG Study of Naming and Requesting
    Natalia Egorova
    Friedemann Pulvermüller
    Yury Shtyrov
    Brain Topography, 2014, 27 : 375 - 392
  • [10] Neural Dynamics of Speech Act Comprehension: An MEG Study of Naming and Requesting
    Egorova, Natalia
    Pulvermueller, Friedemann
    Shtyrov, Yury
    BRAIN TOPOGRAPHY, 2014, 27 (03) : 375 - 392