Influence of Audio Triggered Emotional Attention on Video Perception

被引：1

作者：

Torres, Freddy ^{[1
]}

Kalva, Hari ^{[1
]}

机构：

[1] Florida Atlantic Univ, Dept Comp Sci & Engn, Boca Raton, FL 33431 USA

来源：

HUMAN VISION AND ELECTRONIC IMAGING XIX | 2014年 / 9014卷

关键词：

audio; emotion; visual attention; perception; compression; MECHANISMS;

D O I：

10.1117/12.2041296

中图分类号：

TM [电工技术]; TN [电子技术、通信技术];

学科分类号：

0808 ; 0809 ;

摘要：

Perceptual video coding methods attempt to improve compression efficiency by discarding visual information not perceived by end users. Most of the current approaches for perceptual video coding only use visual features ignoring the auditory component. Many psychophysical studies have demonstrated that auditory stimuli affects our visual perception. In this paper we present our study of audio triggered emotional attention and it's applicability to perceptual video coding. Experiments with movie clips show that the reaction time to detect video compression artifacts was longer when video was presented with the audio information. The results reported are statistically significant with p=0.024.

引用

页数：6

共 50 条

[1] Attention in perception of emotional information
Nusbaum, HC
Norris, CJ
Cacioppo, JT
PSYCHOPHYSIOLOGY, 2004, 41 : S13 - S13
[2] The Influence of Action Video Gaming Experience on the Perception of Emotional Faces and Emotional Word Meaning
Yan, Yuening
Li, Yi
Lou, Xinyu
Li, Senqi
Yao, Yutong
Gong, Diankun
Ma, Weiyi
Yan, Guojian
NEURAL PLASTICITY, 2021, 2021
[3] Audio-Driven Emotional Video Portraits
Ji, Xinya
Zhou, Hang
Wang, Kaisiyuan
Wu, Wayne
Loy, Chen Change
Cao, Xun
Xu, Feng
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 14075 - 14084
[4] The New Italian Audio and Video Emotional Database
Esposito, Anna
Riviello, Maria Teresa
DEVELOPMENT OF MULTIMODAL INTERFACES: ACTIVE LISTING AND SYNCHRONY, 2010, 5967 : 406 - 422
[5] Video and Audio Compressions and Human Perception Mechanism
Bank, Michael
PROCEEDINGS OF THE 12TH WSEAS INTERNATIONAL CONFERENCE ON COMMUNICATIONS: NEW ASPECTS OF COMMUNICATIONS, 2008, : 225 - +
[6] Audio - visual perception of video and multimedia programs
Dvorko, N
Ershov, K
ARCHITECTURAL ACOUSTICS AND SOUND REINFORCEMENT, 2002, : 240 - 242
[7] Audio emotion perception and video highlight extraction
Yu, Chunyan
Weng, Zilin
Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2015, 27 (10): : 1890 - 1899
[8] A crowd of emotional voices influences the perception of emotional faces: Using adaptation, stimulus salience, and attention to probe audio-visual interactions for emotional stimuli
Sarah C. Izen
Vivian M. Ciaramitaro
Attention, Perception, & Psychophysics, 2020, 82 : 3973 - 3992
[9] A crowd of emotional voices influences the perception of emotional faces: Using adaptation, stimulus salience, and attention to probe audio-visual interactions for emotional stimuli
Izen, Sarah C.
Ciaramitaro, Vivian M.
ATTENTION PERCEPTION & PSYCHOPHYSICS, 2020, 82 (08) : 3973 - 3992
[10] The Influence of Audio on Video Memorability with an Audio Gestalt Regulated Video Memorability System
Sweeney, Lorin
Healy, Graham
Smeaton, Alan F.
2021 INTERNATIONAL CONFERENCE ON CONTENT-BASED MULTIMEDIA INDEXING (CBMI), 2021, : 23 - 28

← 1 2 3 4 5 →