Decoding the temporal dynamics of spoken word and nonword processing from EEG

被引:10
|
作者
McMurray, Bob [1 ,2 ]
Sarrett, McCall E. [3 ]
Chiu, Samantha [4 ]
Black, Alexis K. [5 ]
Wang, Alice [6 ]
Canale, Rebecca [7 ]
Aslin, Richard N. [8 ,9 ,10 ]
机构
[1] Univ Iowa, Dept Psychol & Brain Sci, Dept Commun Sci & Disorders, Dept Linguist, Iowa City, IA 52242 USA
[2] Univ Iowa, Dept Otolaryngol, Iowa City, IA 52242 USA
[3] Univ Iowa, Interdisciplinary Grad Program Neurosci, Iowa City, IA USA
[4] Univ Iowa, Dept Psychol & Brain Sci, 278 PBSB, Iowa City, IA 52242 USA
[5] Univ British Columbia, Sch Audiol & Speech Sci, Haskins Labs, Vancouver, BC, Canada
[6] Univ Oregon, Haskins Labs, Dept Psychol, Eugene, OR 97403 USA
[7] Univ Connecticut, Dept Psychol Sci, Haskins Labs, Storrs, CT USA
[8] Yale Univ, Dept Psychol, Haskins Labs, New Haven, CT USA
[9] Yale Univ, Ctr Child Study, New Haven, CT 06520 USA
[10] Univ Connecticut, Dept Psychol, Storrs, CT USA
关键词
Spoken Word Recognition; Speech Decoding; EEG; Machine Learning; TIME-COURSE; LEXICAL COMPETITION; PATTERN-ANALYSIS; TRACE MODEL; RECOGNITION; PERCEPTION; INTEGRATION; TRACKING; SIGNAL; SOUND;
D O I
10.1016/j.neuroimage.2022.119457
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
The efficiency of spoken word recognition is essential for real-time communication. There is consensus that this efficiency relies on an implicit process of activating multiple word candidates that compete for recognition as the acoustic signal unfolds in real-time. However, few methods capture the neural basis of this dynamic competition on a msec-by-msec basis. This is crucial for understanding the neuroscience of language, and for understanding hearing, language and cognitive disorders in people for whom current behavioral methods are not suitable. We applied machine-learning techniques to standard EEG signals to decode which word was heard on each trial and analyzed the patterns of confusion over time. Results mirrored psycholinguistic findings: Early on, the decoder was equally likely to report the target (e.g., baggage ) or a similar sounding competitor ( badger ), but by around 500 msec, competitors were suppressed. Follow up analyses show that this is robust across EEG systems (gel and saline), with fewer channels, and with fewer trials. Results are robust within individuals and show high reliability. This suggests a powerful and simple paradigm that can assess the neural dynamics of speech decoding, with potential applications for understanding lexical development in a variety of clinical disorders.
引用
收藏
页数:19
相关论文
共 50 条
  • [41] Spoken word processing and the effect of phonemic mismatch in aphasia
    Janse, Esther
    APHASIOLOGY, 2010, 24 (01) : 3 - 27
  • [42] Phonological priming in Cantonese spoken-word processing
    Yip, MCW
    PSYCHOLOGIA, 2001, 44 (03) : 223 - 229
  • [43] Effects of word recognition errors in spoken query processing
    Crestani, F
    IEEE ADVANCES IN DIGITAL LIBRARIES 2000, PROCEEDINGS, 2000, : 39 - 47
  • [44] Lexical tone in Cantonese spoken-word processing
    Anne Cutler
    Hsuan-Chih Chen
    Perception & Psychophysics, 1997, 59 : 165 - 179
  • [45] A CONNECTIONIST MODEL OF PRELEXICAL PROCESSING IN SPOKEN WORD RECOGNITION
    SHILLCOCK, RC
    LEVY, J
    CHATER, N
    INTERNATIONAL JOURNAL OF PSYCHOLOGY, 1992, 27 (3-4) : 63 - 63
  • [46] Lexical tone in Cantonese spoken-word processing
    Cutler, A
    Chen, HC
    PERCEPTION & PSYCHOPHYSICS, 1997, 59 (02): : 165 - 179
  • [47] Author Correction: EEG Decoding Reveals the Strength and Temporal Dynamics of Goal-Relevant Representations
    Jason Hubbard
    Atsushi Kikumoto
    Ulrich Mayr
    Scientific Reports, 10
  • [48] RECOGNITION OF SILENTLY SPOKEN WORD FROM EEG SIGNALS USING DENSE ATTENTION NETWORK (DAN).
    Datta, Sahil
    Aondoakaa, Akuha
    Holmberg, Jorunn Jo
    Antonova, Elena
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 4558 - 4562
  • [49] Phonological facilitation from pictures in a word association task: Evidence for routine cascaded processing in spoken word production
    Humphreys, Karin R.
    Boyd, Candice H.
    Watter, Scott
    QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 2010, 63 (12): : 2289 - 2296
  • [50] Multiple routes for compound word processing in the brain: Evidence from EEG
    MacGregor, Lucy J.
    Shtyrov, Yury
    BRAIN AND LANGUAGE, 2013, 126 (02) : 217 - 229