Event-related Potentials in Audio–Visual Cross-Modal Test for Comparison of Word Pairs

被引:1
|
作者
Nikishena I.S. [1 ]
Ponomarev V.A. [1 ]
Kropotov Y.D. [1 ]
机构
[1] Bechtereva Institute of the Human Brain, Russian Academy of Sciences, St. Petersburg
关键词
cross-modal interaction; event-related potentials; two-modal GO–NOGO paradigm; word’s phonological representation; working memory;
D O I
10.1134/S0362119721020109
中图分类号
学科分类号
摘要
Abstract: The study was aimed at investigating specificities of brain functioning when comparing verbal signals in cross-modal interaction. Event-related potentials (ERPs) were recorded in 166 healthy subjects in a two-modal, two-stimulus test in the GO–NOGO paradigm where the first stimulus was a visual presentation of the word, and the second stimulus was an auditory presentation of the word. It was shown that while the subjects were waiting for the spoken word to follow the printed word, an activation was recorded in the frontal-temporal area of their left hemisphere (F7, F3), presumably associated with the formation of the word’s phonological representation in the memory. Upon producing the second (spoken) word if it coincides with the visual presentation, the peak activation is recorded in the posterior temporal positions (Т5, Т6) within the interval of 370–500 ms; if the second stimulus does not coincide with the first one, the peak activation is recorded in the occipital positions (O1, O2) within the interval of 590–800 ms. These ERP fluctuations supposedly result from the processes of comparing the newly received auditory information with the phonological representation of the word stored in the working memory. © 2021, Pleiades Publishing, Inc.
引用
收藏
页码:459 / 466
页数:7
相关论文
共 50 条
  • [31] Intra-modal and cross-modal spatial attention to auditory and visual stimuli.: An event-related brain potential study
    Teder-Sälejärvi, WA
    Münte, TF
    Sperlich, FJ
    Hillyard, SA
    COGNITIVE BRAIN RESEARCH, 1999, 8 (03): : 327 - 343
  • [32] CROSS-MODAL PRIMING EFFECT BASED ON SHORT-TERM EXPERIENCE OF ECOLOGICALLY UNRELATED AUDIO-VISUAL INFORMATION: AN EVENT-RELATED POTENTIAL STUDY
    Liu, B.
    Wu, G.
    Meng, X.
    NEUROSCIENCE, 2012, 223 : 21 - 27
  • [33] Deep Cross-Modal Audio-Visual Generation
    Chen, Lele
    Srivastava, Sudhanshu
    Duan, Zhiyao
    Xu, Chenliang
    PROCEEDINGS OF THE THEMATIC WORKSHOPS OF ACM MULTIMEDIA 2017 (THEMATIC WORKSHOPS'17), 2017, : 349 - 357
  • [34] Audio-to-Visual Cross-Modal Generation of Birds
    Shim, Joo Yong
    Kim, Joongheon
    Kim, Jong-Kook
    IEEE ACCESS, 2023, 11 : 27719 - 27729
  • [35] Cross-modal prediction in audio-visual communication
    Rao, RR
    Chen, TH
    1996 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, CONFERENCE PROCEEDINGS, VOLS 1-6, 1996, : 2056 - 2059
  • [36] COMPARISON OF EVENT-RELATED POTENTIALS OF YOUNG-CHILDREN AND ADULTS IN A VISUAL RECOGNITION AND WORD READING TASK
    ROOIJAKKERS, JAJ
    KOK, A
    BIOLOGICAL PSYCHOLOGY, 1985, 20 (03) : 209 - 210
  • [37] COMPARISON OF EVENT-RELATED POTENTIALS OF YOUNG-CHILDREN AND ADULTS IN A VISUAL RECOGNITION AND WORD READING TASK
    KOK, A
    ROOIJAKKERS, JAJ
    PSYCHOPHYSIOLOGY, 1985, 22 (01) : 11 - 23
  • [38] MODULATION OF EVENT-RELATED POTENTIALS BY WORD REPETITION - THE ROLE OF VISUAL SELECTIVE ATTENTION
    OTTEN, LJ
    RUGG, MD
    DOYLE, MC
    PSYCHOPHYSIOLOGY, 1993, 30 (06) : 559 - 571
  • [39] Cross-modal processing of auditory-visual stimuli in a no-task paradigm:: A topographic event-related potential study
    Vidal, J.
    Giard, M. -H.
    Roux, S.
    Barthelemy, C.
    Bruneau, N.
    CLINICAL NEUROPHYSIOLOGY, 2008, 119 (04) : 763 - 771
  • [40] CROSS-MODAL SEQUENTIAL EFFECTS ON P300 COMPONENT OF EVENT-RELATED POTENTIAL
    SQUIRES, NK
    DUNCANJOHNSON, CC
    SQUIRES, KC
    DONCHIN, E
    PSYCHOPHYSIOLOGY, 1977, 14 (01) : 96 - 96