On-Beat/Off-Beat Visual Responses to Audio-Visual Asynchrony in Music Videos

被引:0
|
作者
Swenberg, Thorbjorn [1 ]
Carlgren, Simon [1 ]
机构
[1] Dalarna Univ, Moving Image Prod Dept, Falun, Sweden
关键词
audio-visual asynchrony; audio-visual rhythm; audio-visual synchrony; cueing; eye-tracking; music video; COGNITIVE LOAD; SYNCHRONY PERCEPTION; EXPRESS SACCADES; EYE-MOVEMENTS; REACTION-TIME; INTEGRATION; ATTENTION; CONTINUITY; RHYTHMS; TASK;
D O I
10.3167/proj.2021.150103
中图分类号
J9 [电影、电视艺术]; I235 [电影、电视、广播剧];
学科分类号
摘要
Audio-visual rhythm can be achieved in a variety of ways, in film as well as in music videos. Here, we have studied human visual responses to video editing with regard to musical beats, in order to better understand the role of visual rhythm in an audio-visual flow. While some suggest that music videos should maintain synchrony in the audio-visual rhythm, and others claim that music videos should be rhythmically loose in their structure, there is a functional aspect of vision and hearing that reacts to the juxtaposition of audio and visual rhythms. We present empirical evidence of cognitive effects, as well as perceptual differences with attentional effects, for viewers watching music videos cut on-beat and off-beat.
引用
收藏
页码:28 / 54
页数:27
相关论文
共 50 条
  • [21] Unified Audio-Visual Saliency Model for Omnidirectional Videos With Spatial Audio
    Zhu, Dandan
    Zhang, Kaiwei
    Zhang, Nana
    Zhou, Qiangqiang
    Min, Xiongkuo
    Zhai, Guangtao
    Yang, Xiaokang
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 764 - 775
  • [22] Experience with crossmodal statistics reduces the sensitivity for audio-visual temporal asynchrony
    Habets, Boukje
    Bruns, Patrick
    Roeder, Brigitte
    SCIENTIFIC REPORTS, 2017, 7
  • [23] Audio-Visual Emotion Recognition Based on a DBN Model with Constrained Asynchrony
    Chen, Danqi
    Jiang, Dongmei
    Ravyse, Ilse
    Sahli, Hichem
    PROCEEDINGS OF THE FIFTH INTERNATIONAL CONFERENCE ON IMAGE AND GRAPHICS (ICIG 2009), 2009, : 912 - 916
  • [24] Effects of temporal asynchrony and stimulus magnitude on competitive audio-visual binding
    Wilbiks, Jonathan M. P.
    Dyson, Benjamin J.
    ATTENTION PERCEPTION & PSYCHOPHYSICS, 2013, 75 (08) : 1883 - 1891
  • [25] Asynchrony adaptation reveals neural population code for audio-visual timing
    Roach, Neil W.
    Heron, James
    Whitaker, David
    McGraw, Paul V.
    PROCEEDINGS OF THE ROYAL SOCIETY B-BIOLOGICAL SCIENCES, 2011, 278 (1710) : 1314 - 1322
  • [26] Experience with crossmodal statistics reduces the sensitivity for audio-visual temporal asynchrony
    Boukje Habets
    Patrick Bruns
    Brigitte Röder
    Scientific Reports, 7
  • [27] Multi-stream asynchrony modeling for audio-visual speech recognition
    Lv, Guoyun
    Jiang, Dongmei
    Zhao, Rongchun
    Hou, Yunshu
    ISM 2007: NINTH IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA, PROCEEDINGS, 2007, : 37 - 44
  • [28] Temporal frequency characteristics of synchrony–asynchrony discrimination of audio-visual signals
    Waka Fujisaki
    Shin’ya Nishida
    Experimental Brain Research, 2005, 166 : 455 - 464
  • [29] Saliency Prediction in Uncategorized Videos Based on Audio-Visual Correlation
    Qamar, Maryam
    Qamar, Suleman
    Muneeb, Muhammad
    Bae, Sung-Ho
    Rahman, Anis
    IEEE ACCESS, 2023, 11 : 15460 - 15470
  • [30] Audio-visual object removal in 360-degree videos
    Shimamura, Ryo
    Feng, Qi
    Koyama, Yuki
    Nakatsuka, Takayuki
    Fukayama, Satoru
    Hamasaki, Masahiro
    Goto, Masataka
    Morishima, Shigeo
    VISUAL COMPUTER, 2020, 36 (10-12): : 2117 - 2128