Visual localization ability influences cross-modal bias

被引:117
|
作者
Hairston, WD [1 ]
Wallace, MT [1 ]
Vaughan, JW [1 ]
Stein, BE [1 ]
Norris, JL [1 ]
Schirillo, JA [1 ]
机构
[1] Wake Forest Univ, Bowman Gray Sch Med, Dept Neurobiol & Anat, Winston Salem, NC 27157 USA
关键词
D O I
10.1162/089892903321107792
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
The ability of a visual signal to influence the localization of an auditory target (i.e., "cross-modal bias") was examined as a function of the spatial disparity between the two stimuli and their absolute locations in space. Three experimental issues were examined: (a) the effect of a spatially disparate visual stimulus on auditory localization judgments; (b) how the ability to localize visual, auditory, and spatially aligned multisensory (visual-auditory) targets is related to cross-modal bias, and (c) the relationship between the magnitude of cross-modal bias and the perception that the two stimuli are spatially "unified" (i.e., originate from the same location). Whereas variability in localization of auditory targets was large and fairly uniform for all tested locations, variability in localizing visual or spatially aligned multisensory targets was much smaller, and increased with increasing distance from the midline. This trend proved to be strongly correlated with biasing effectiveness, for although visual-auditory bias was unexpectedly large in all conditions tested, it decreased progressively (as localization variability increased) with increasing distance from the midline. Thus, central visual stimuli had a substantially greater biasing effect on auditory target localization than did more peripheral visual stimuli. It was also apparent that cross-modal bias decreased as the degree of visual-auditory disparity increased. Consequently, the greatest visual-auditory biases were obtained with small disparities at central locations. In all cases, the magnitude of these biases covaried with judgments of spatial unity. The results suggest that functional properties of the visual system play the predominant role in determining these visual-auditory interactions and that cross-modal biases can be substantially greater than previously noted.
引用
收藏
页码:20 / 29
页数:10
相关论文
共 50 条
  • [1] Persistent Stereo Visual Localization on Cross-Modal Invariant Map
    Ding, Xiaqing
    Wang, Yue
    Xiong, Rong
    Li, Dongxuan
    Tang, Li
    Yin, Huan
    Zhao, Liang
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2020, 21 (11) : 4646 - 4658
  • [2] Visual Sound Localization in the Wild by Cross-Modal Interference Erasing
    Liu, Xian
    Qian, Rui
    Zhou, Hang
    Hu, Di
    Lin, Weiyao
    Liu, Ziwei
    Zhou, Bolei
    Zhou, Xiaowei
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 1801 - 1809
  • [3] Recent cross-modal statistical learning influences visual perceptual selection
    Piazza, Elise A.
    Denison, Rachel N.
    Silver, Michael A.
    JOURNAL OF VISION, 2018, 18 (03): : 1 - 12
  • [4] Visual capture of a stereo sound: Interactions between cue reliability, sound localization variability, and cross-modal bias
    Montagne, Christopher
    Zhou, Yi
    JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2016, 140 (01): : 471 - 485
  • [5] Unconscious Cross-Modal Priming of Auditory Sound Localization by Visual Words
    Ansorge, Ulrich
    Khalid, Shah
    Laback, Bernhard
    JOURNAL OF EXPERIMENTAL PSYCHOLOGY-LEARNING MEMORY AND COGNITION, 2016, 42 (06) : 925 - 937
  • [6] Cross-modal Background Suppression for Audio-Visual Event Localization
    Xia, Yan
    Zhao, Zhou
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 19957 - 19966
  • [7] SSLNet: A network for cross-modal sound source localization in visual scenes
    Feng, Fan
    Ming, Yue
    Hu, Nannan
    NEUROCOMPUTING, 2022, 500 : 1052 - 1062
  • [8] Temporal Cross-Modal Attention for Audio-Visual Event Localization
    Nagasaki Y.
    Hayashi M.
    Kaneko N.
    Aoki Y.
    Seimitsu Kogaku Kaishi/Journal of the Japan Society for Precision Engineering, 2022, 88 (03): : 263 - 268
  • [9] DEVELOPMENT OF - WITHIN-MODAL AND CROSS-MODAL MATCHING ABILITY IN AUDITORY AND VISUAL SENSE MODALITIES
    KUHLMAN, ES
    WOLKING, WD
    DEVELOPMENTAL PSYCHOLOGY, 1972, 7 (03) : 365 - 365
  • [10] CROSS-MODAL BIAS AND PERCEPTUAL FUSION WITH AUDITORY-VISUAL SPATIAL DISCORDANCE
    BERTELSON, P
    RADEAU, M
    PERCEPTION & PSYCHOPHYSICS, 1981, 29 (06): : 578 - 584