On-Beat/Off-Beat Visual Responses to Audio-Visual Asynchrony in Music Videos

被引:0
|
作者
Swenberg, Thorbjorn [1 ]
Carlgren, Simon [1 ]
机构
[1] Dalarna Univ, Moving Image Prod Dept, Falun, Sweden
关键词
audio-visual asynchrony; audio-visual rhythm; audio-visual synchrony; cueing; eye-tracking; music video; COGNITIVE LOAD; SYNCHRONY PERCEPTION; EXPRESS SACCADES; EYE-MOVEMENTS; REACTION-TIME; INTEGRATION; ATTENTION; CONTINUITY; RHYTHMS; TASK;
D O I
10.3167/proj.2021.150103
中图分类号
J9 [电影、电视艺术]; I235 [电影、电视、广播剧];
学科分类号
摘要
Audio-visual rhythm can be achieved in a variety of ways, in film as well as in music videos. Here, we have studied human visual responses to video editing with regard to musical beats, in order to better understand the role of visual rhythm in an audio-visual flow. While some suggest that music videos should maintain synchrony in the audio-visual rhythm, and others claim that music videos should be rhythmically loose in their structure, there is a functional aspect of vision and hearing that reacts to the juxtaposition of audio and visual rhythms. We present empirical evidence of cognitive effects, as well as perceptual differences with attentional effects, for viewers watching music videos cut on-beat and off-beat.
引用
收藏
页码:28 / 54
页数:27
相关论文
共 50 条
  • [31] Synchronization of Multiple Camera Videos Using Audio-Visual Features
    Shrestha, Prarthana
    Barbieri, Mauro
    Weda, Hans
    Sekulovski, Dragan
    IEEE TRANSACTIONS ON MULTIMEDIA, 2010, 12 (01) : 79 - 92
  • [32] A Multimodal Saliency Model for Videos With High Audio-Visual Correspondence
    Min, Xiongkuo
    Zhai, Guangtao
    Zhou, Jiantao
    Zhang, Xiao-Ping
    Yang, Xiaokang
    Guan, Xinping
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 3805 - 3819
  • [33] Modulation of visual responses in the superior temporal sulcus by audio-visual congruency
    Dahl, Christoph D.
    Logothetis, Nikos K.
    Kayser, Christoph
    FRONTIERS IN INTEGRATIVE NEUROSCIENCE, 2010, 4
  • [34] Audio-visual beat tracking based on a state-space model for a robot dancer performing with a human dancer
    Ohkita M.
    Bando Y.
    Nakamura E.
    Itoyama K.
    Yoshii K.
    1600, Fuji Technology Press (29): : 125 - 136
  • [35] The Impact of Equine Therapy and an Audio-Visual Approach Emphasizing Rhythm and Beat Perception in Children with Developmental Coordination Disorder
    Hession, Caren E.
    Smith, Miriam J. Law
    Watterson, David
    Oxley, Nigel
    Murphy, Barbara A.
    JOURNAL OF ALTERNATIVE AND COMPLEMENTARY MEDICINE, 2019, 25 (05) : 535 - 541
  • [36] Management Software Development for Online Music Audio-visual
    Wang, Jian
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON ADVANCES IN MECHANICAL ENGINEERING AND INDUSTRIAL INFORMATICS, 2015, 15 : 378 - 381
  • [37] On the correlation of automatic audio and visual segmentations of music videos
    Gillet, Olivier
    Essid, Slim
    Richard, Gael
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2007, 17 (03) : 347 - 355
  • [38] Beat Synchronous Dance Animation Based on Visual Analysis of Human Motion and Audio Analysis of Music Tempo
    Panagiotakis, Costas
    Holzapfel, Andre
    Michel, Damien
    Argyros, Antonis A.
    ADVANCES IN VISUAL COMPUTING, PT II, 2013, 8034 : 118 - 127
  • [39] Audio-visual speech perception off the top of the head
    Davis, Chris
    Kim, Jeesun
    COGNITION, 2006, 100 (03) : B21 - B31
  • [40] Distinct mechanisms of audio-visual asynchrony adaptation operate over different timescales
    Maddison, Sarah
    Roach, Neil W.
    Webb, Ben S.
    PERCEPTION, 2015, 44 : 344 - 344