Auditory-visual interactions in egocentric distance perception: Ventriloquism effect and aftereffecta)

被引:5
|
作者
Hladek, L'ubos [1 ,3 ]
Seitz, Aaron R. [2 ]
Kopco, Norbert [1 ]
机构
[1] Safarik Univ, Inst Comp Sci, Jesenna 5, Kosice 04001, Slovakia
[2] Univ Calif Riverside, Dept Psychol, 900 Univ Ave, Riverside, CA 92521 USA
[3] Tech Univ Munich, Audio Informat Proc, D-80333 Munich, Germany
来源
关键词
AUDIOVISUAL ENVIRONMENTS; LOCALIZATION CUES; SOUND; RECALIBRATION; ADAPTATION; PLASTICITY; DIRECTION; LOUDNESS; DEPEND; HEAD;
D O I
10.1121/10.0007066
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
This study describes data on auditory-visual integration and visually-guided adaptation of auditory distance perception using the ventriloquism effect (VE) and ventriloquism aftereffect (VAE). In an experiment, participants judged egocentric distance of interleaved auditory or auditory-visual stimuli with the auditory component located from 0.7 to 2.04 m in front of listeners in a real reverberant environment. The visual component of auditory-visual stimuli was displaced 30% closer (V-closer), 30% farther (V-farther), or aligned (V-aligned) with respect to the auditory component. The VE and VAE were measured in auditory and auditory-visual trials, respectively. Both effects were approximately independent of target distance when expressed in logarithmic units. The VE strength, defined as a difference of V-misaligned and V-aligned response bias, was approximately 72% of the auditory-visual disparity regardless of the visual-displacement direction, while the VAE was stronger in the V-farther (44%) than the V-closer (31%) condition. The VAE persisted to post-adaptation auditory-only blocks of trials, although it was diminished. The rates of build-up/break-down of the VAE were asymmetrical, with slower adaptation in the V-closer condition. These results suggest that auditory-visual distance integration is independent of the direction of induced shift, while the re-calibration is stronger and faster when evoked by more distant visual stimuli. (c) 2021 Acoustical Society of America.
引用
收藏
页码:3593 / 3607
页数:15
相关论文
共 50 条
  • [21] Interactions in perceived quality of auditory-visual displays
    Storms, RL
    Zyda, MJ
    PRESENCE-TELEOPERATORS AND VIRTUAL ENVIRONMENTS, 2000, 9 (06) : 557 - 580
  • [22] Impact of language on development of auditory-visual speech perception
    Sekiyama, Kaoru
    Burnham, Denis
    DEVELOPMENTAL SCIENCE, 2008, 11 (02) : 306 - 320
  • [23] PERCEPTION OF AUDITORY-VISUAL SIMULTANEITY CHANGES BY ILLUMINANCE AT THE EYES
    Hasegawa, Hiroshi
    Hatakeyama, Shu
    PROCEEDINGS OF THE 23RD INTERNATIONAL CONGRESS ON SOUND AND VIBRATION: FROM ANCIENT TO MODERN ACOUSTICS, 2016,
  • [24] AUDITORY-VISUAL PERCEPTION OF SPEECH WITH REDUCED OPTICAL CLARITY
    ERBER, NP
    JOURNAL OF SPEECH AND HEARING RESEARCH, 1979, 22 (02): : 212 - 223
  • [25] Perception of auditory-visual temporal synchrony in human infants
    Lewkowicz, DJ
    JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE, 1996, 22 (05) : 1094 - 1106
  • [26] Brain activation during auditory-visual speech perception
    Sekiyama, K
    Sugita, Y
    EUROPEAN JOURNAL OF NEUROSCIENCE, 2000, 12 : 169 - 169
  • [27] Auditory-visual contextual cuing effect
    Kawahara, Jun-Ichiro
    PERCEPTION & PSYCHOPHYSICS, 2007, 69 (08): : 1399 - 1408
  • [28] Temporal window of integration in auditory-visual speech perception
    van Wassenhove, Virginie
    Grant, Ken W.
    Poeppel, David
    NEUROPSYCHOLOGIA, 2007, 45 (03) : 598 - 607
  • [29] Age Differences in the Effects of Speaking Rate on Auditory, Visual, and Auditory-Visual Speech Perception
    Sommers, Mitchell S.
    Spehar, Brent
    Tye-Murray, Nancy
    Myerson, Joel
    Hale, Sandra
    EAR AND HEARING, 2020, 41 (03): : 549 - 560
  • [30] Auditory-visual and auditory-only perception of phonetic contrasts in children
    Eisenberg, LS
    Martinez, AS
    Boothroyd, A
    VOLTA REVIEW, 2003, 103 (04) : 327 - 346