Auditory-visual interactions in egocentric distance perception: Ventriloquism effect and aftereffecta)

被引:5
|
作者
Hladek, L'ubos [1 ,3 ]
Seitz, Aaron R. [2 ]
Kopco, Norbert [1 ]
机构
[1] Safarik Univ, Inst Comp Sci, Jesenna 5, Kosice 04001, Slovakia
[2] Univ Calif Riverside, Dept Psychol, 900 Univ Ave, Riverside, CA 92521 USA
[3] Tech Univ Munich, Audio Informat Proc, D-80333 Munich, Germany
来源
关键词
AUDIOVISUAL ENVIRONMENTS; LOCALIZATION CUES; SOUND; RECALIBRATION; ADAPTATION; PLASTICITY; DIRECTION; LOUDNESS; DEPEND; HEAD;
D O I
10.1121/10.0007066
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
This study describes data on auditory-visual integration and visually-guided adaptation of auditory distance perception using the ventriloquism effect (VE) and ventriloquism aftereffect (VAE). In an experiment, participants judged egocentric distance of interleaved auditory or auditory-visual stimuli with the auditory component located from 0.7 to 2.04 m in front of listeners in a real reverberant environment. The visual component of auditory-visual stimuli was displaced 30% closer (V-closer), 30% farther (V-farther), or aligned (V-aligned) with respect to the auditory component. The VE and VAE were measured in auditory and auditory-visual trials, respectively. Both effects were approximately independent of target distance when expressed in logarithmic units. The VE strength, defined as a difference of V-misaligned and V-aligned response bias, was approximately 72% of the auditory-visual disparity regardless of the visual-displacement direction, while the VAE was stronger in the V-farther (44%) than the V-closer (31%) condition. The VAE persisted to post-adaptation auditory-only blocks of trials, although it was diminished. The rates of build-up/break-down of the VAE were asymmetrical, with slower adaptation in the V-closer condition. These results suggest that auditory-visual distance integration is independent of the direction of induced shift, while the re-calibration is stronger and faster when evoked by more distant visual stimuli. (c) 2021 Acoustical Society of America.
引用
收藏
页码:3593 / 3607
页数:15
相关论文
共 50 条
  • [41] Methods for measuring egocentric distance perception in visual modality
    Dong, Bo
    Chen, Airui
    Gu, Zhengyin
    Sun, Yuan
    Zhang, Xiuling
    Tian, Xiaoming
    FRONTIERS IN PSYCHOLOGY, 2023, 13
  • [42] DYNAMIC CORTICAL INTERACTIONS DURING AUDITORY-VISUAL INTEGRATION
    Gilley, Phillip M.
    PSYCHOPHYSIOLOGY, 2010, 47 : S102 - S102
  • [43] REVERBERATION AND SPECIFIC DISTANCE TENDENCY AS FACTORS IN AUDITORY-PERCEPTION OF EGOCENTRIC DISTANCE
    MERSHON, DH
    BOWERS, JN
    BULLETIN OF THE PSYCHONOMIC SOCIETY, 1976, 8 (04) : 253 - 253
  • [44] AUDITORY-VISUAL INTERACTIONS AND CORRESPONDENCE BETWEEN PERCEIVED AUDITORY SPACE AND PERCEIVED VISUAL SPACE
    REGAN, D
    SPEKREIJSE, H
    PERCEPTION, 1977, 6 (02) : 133 - 138
  • [45] Auditory-visual temporal integration as a function of distance: no compensation for sound-transmission time in human perception
    Lewald, J
    Guski, R
    NEUROSCIENCE LETTERS, 2004, 357 (02) : 119 - 122
  • [46] Auditory-visual speech integration by prelinguistic infants: Perception of an emergent consonant in the McGurk effect
    Burnham, D
    Dodd, B
    DEVELOPMENTAL PSYCHOBIOLOGY, 2004, 45 (04) : 204 - 220
  • [47] Auditory-visual multisensory interactions attenuate subsequent visual responses in humans
    Meylan, Raphael V.
    Murray, Micah M.
    NEUROIMAGE, 2007, 35 (01) : 244 - 254
  • [48] Auditory-visual Tone Perception in Hearing Impaired Thai Listeners
    Kasisopa, Benjawan
    Klangpornkun, Nittayapa
    Burnham, Denis
    16TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2015), VOLS 1-5, 2015, : 2962 - 2966
  • [49] Auditory-visual speech perception is abnormal in schizophrenia: An fMRI study
    Surguladze, SA
    Calvert, GA
    Brammer, MJ
    Rossell, SL
    Giampietro, VP
    Sullmore, ET
    Williams, SC
    Campbell, R
    David, AS
    SCHIZOPHRENIA RESEARCH, 1999, 36 (1-3) : 234 - 235
  • [50] SPACE PERCEPTION IN EARLY INFANCY - PERCEPTION WITHIN COMMON AUDITORY-VISUAL SPACE
    ARONSON, E
    ROSENBLOOM, S
    SCIENCE, 1971, 172 (3988) : 1161 - +