On-Beat/Off-Beat Visual Responses to Audio-Visual Asynchrony in Music Videos

被引:0
|
作者
Swenberg, Thorbjorn [1 ]
Carlgren, Simon [1 ]
机构
[1] Dalarna Univ, Moving Image Prod Dept, Falun, Sweden
关键词
audio-visual asynchrony; audio-visual rhythm; audio-visual synchrony; cueing; eye-tracking; music video; COGNITIVE LOAD; SYNCHRONY PERCEPTION; EXPRESS SACCADES; EYE-MOVEMENTS; REACTION-TIME; INTEGRATION; ATTENTION; CONTINUITY; RHYTHMS; TASK;
D O I
10.3167/proj.2021.150103
中图分类号
J9 [电影、电视艺术]; I235 [电影、电视、广播剧];
学科分类号
摘要
Audio-visual rhythm can be achieved in a variety of ways, in film as well as in music videos. Here, we have studied human visual responses to video editing with regard to musical beats, in order to better understand the role of visual rhythm in an audio-visual flow. While some suggest that music videos should maintain synchrony in the audio-visual rhythm, and others claim that music videos should be rhythmically loose in their structure, there is a functional aspect of vision and hearing that reacts to the juxtaposition of audio and visual rhythms. We present empirical evidence of cognitive effects, as well as perceptual differences with attentional effects, for viewers watching music videos cut on-beat and off-beat.
引用
收藏
页码:28 / 54
页数:27
相关论文
共 50 条
  • [41] Temporal frequency characteristics of synchrony-asynchrony discrimination of audio-visual signals
    Fujisaki, W
    Nishida, S
    EXPERIMENTAL BRAIN RESEARCH, 2005, 166 (3-4) : 455 - 464
  • [42] Summarization of Multiple News Videos Considering the Consistency of Audio-Visual Contents
    Zhang, Ye
    Tanishige, Ryunosuke
    Ide, Ichiro
    Doman, Keisuke
    Kawanishi, Yasutomo
    Deguchi, Daisuke
    Murase, Hiroshi
    INTERNATIONAL JOURNAL OF SEMANTIC COMPUTING, 2019, 13 (01) : 135 - 155
  • [43] Multimodal framework based on audio-visual features for summarisation of cricket videos
    Javed, Ali
    Irtaza, Aun
    Malik, Hafiz
    Mahmood, Muhammad Tariq
    Adnan, Syed
    IET IMAGE PROCESSING, 2019, 13 (04) : 615 - 622
  • [44] AVLnet: Learning Audio-Visual Language Representations from Instructional Videos
    Rouditchenko, Andrew
    Boggust, Angie
    Harwath, David
    Chen, Brian
    Joshi, Dhiraj
    Thomas, Samuel
    Audhkhasi, Kartik
    Kuehne, Hilde
    Panda, Rameswar
    Feris, Rogerio
    Kingsbury, Brian
    Picheny, Michael
    Torralba, Antonio
    Glass, James
    INTERSPEECH 2021, 2021, : 1584 - 1588
  • [45] Spherical World-Locking for Audio-Visual Localization in Egocentric Videos
    Yun, Heeseung
    Gao, Ruohan
    Ananthabhotla, Ishwarya
    Kumar, Anurag
    Donley, Jacob
    Li, Chao
    Kim, Gunhee
    Ithapu, Vamsi Krishna
    Murdock, Calvin
    COMPUTER VISION - ECCV 2024, PT XXIV, 2025, 15082 : 256 - 274
  • [46] Automatic Piano Music Transcription Using Audio-Visual Features
    Wan Yulong
    Wang Xianliang
    Zhou Ruohua
    Yan Yonghong
    CHINESE JOURNAL OF ELECTRONICS, 2015, 24 (03) : 596 - 603
  • [47] Automatic Piano Music Transcription Using Audio-Visual Features
    WAN Yulong
    WANG Xianliang
    ZHOU Ruohua
    YAN Yonghong
    ChineseJournalofElectronics, 2015, 24 (03) : 596 - 603
  • [48] Neural responses to sounds presented on and off the beat of ecologically valid music
    Tierney, Adam
    Kraus, Nina
    FRONTIERS IN SYSTEMS NEUROSCIENCE, 2013, 7
  • [49] SEGMENTATION OF MUSIC VIDEO STREAMS IN MUSIC PIECES THROUGH AUDIO-VISUAL ANALYSIS
    Sargent, Gabriel
    Hanna, Pierre
    Nicolas, Henri
    2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
  • [50] EEG responses to long-term audio-visual stimulation
    Teplan, M
    Krakovská, A
    Stolc, S
    INTERNATIONAL JOURNAL OF PSYCHOPHYSIOLOGY, 2006, 59 (02) : 81 - 90