Audio-visual dynamic remapping in an endogenous spatial attention task

被引:3
|
作者
Fagioli, Sabrina [1 ]
Couyoumdjian, Alessandro [1 ]
Ferlazzo, Fabio [1 ]
机构
[1] Univ Roma La Sapienza, Dept Psychol, I-00185 Rome, Italy
关键词
cross-modal attention; auditory attention; visual attention; temporal dynamics; spatial representations; endogenous attention; spatial remapping; multisensory integration;
D O I
10.1016/j.bbr.2006.05.030
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
Several studies on cross-modal attention showed that remapping processes between sensory modalities occur in the spatial orienting of attention. One hypothesis that accounts for such links is that spatial attention operates upon representations of common locations in the external space. However, convincing evidence only exists for cross-modal links in spatial orienting, leaving the dynamics of these effects unexplored. Four experiments were designed to cope with this issue by having participants being involved in an endogenous orienting task to visual and auditory target stimuli. Targets on invalid trials were embedded into two different kinds of sequences of stimuli: (1) long sequences, wherein three valid trials in one modality preceded the invalid trial in the other modality; (2) short sequences, wherein only one valid trial in one modality preceded the invalid trial in the other modality. Results revealed modality-specific meridian effects in the short sequences, and a significant decrement of the modality-specific meridian effect in the long sequences. The results of these experiments indicate that cross-modal links in visual and auditory spatial attention are based on representations of common locations in the external space across sensory modalities. Moreover, the results strongly support the hypothesis that representations of space are dynamically built and updated according to task demands. (c) 2006 Elsevier B.V. All rights reserved.
引用
收藏
页码:30 / 38
页数:9
相关论文
共 50 条
  • [41] Efficient video coding based on audio-visual focus of attention
    Lee, Jong-Seok
    De Simone, Francesca
    Ebrahimi, Touradj
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2011, 22 (08) : 704 - 711
  • [42] Attention-Based Audio-Visual Fusion for Video Summarization
    Fang, Yinghong
    Zhang, Junpeng
    Lu, Cewu
    NEURAL INFORMATION PROCESSING (ICONIP 2019), PT II, 2019, 11954 : 328 - 340
  • [43] An audio-visual speech recognition with a new mandarin audio-visual database
    Liao, Wen-Yuan
    Pao, Tsang-Long
    Chen, Yu-Te
    Chang, Tsun-Wei
    INT CONF ON CYBERNETICS AND INFORMATION TECHNOLOGIES, SYSTEMS AND APPLICATIONS/INT CONF ON COMPUTING, COMMUNICATIONS AND CONTROL TECHNOLOGIES, VOL 1, 2007, : 19 - +
  • [44] Active Audio-Visual Separation of Dynamic Sound Sources
    Majumder, Sagnik
    Grauman, Kristen
    COMPUTER VISION, ECCV 2022, PT XXXIX, 2022, 13699 : 551 - 569
  • [45] Dynamic dependency tests for audio-visual speaker association
    Siracusa, Michael R.
    Fisher, John W., III
    2007 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOL II, PTS 1-3, 2007, : 457 - +
  • [46] Dynamic Bayesian Networks for audio-visual speaker recognition
    Li, DD
    Yang, YC
    Wu, ZH
    ADVANCES IN BIOMETRICS, PROCEEDINGS, 2006, 3832 : 539 - 545
  • [47] Dynamic Bayesian Networks for Audio-Visual Speech Recognition
    Ara V. Nefian
    Luhong Liang
    Xiaobo Pi
    Xiaoxing Liu
    Kevin Murphy
    EURASIP Journal on Advances in Signal Processing, 2002
  • [48] Onmidirectional audio-visual talker localization based on dynamic fusion of audio-visual features using validity and reliability criteria
    Denda, Yuki
    Nishiura, Takanobu
    Yamashita, Yoichi
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2008, E91D (03): : 598 - 606
  • [49] On Dynamic Stream Weighting for Audio-Visual Speech Recognition
    Estellers, Virginia
    Gurban, Mihai
    Thiran, Jean-Philippe
    IEEE TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2012, 20 (04): : 1145 - 1157
  • [50] Dynamic Audio-Visual Biometric Fusion for Person Recognition
    Alsaedi, Najlaa Hindi
    Jaha, Emad Sami
    CMC-COMPUTERS MATERIALS & CONTINUA, 2022, 71 (01): : 1283 - 1311