Audio-video emotional response mapping based upon Electrodermal Activity

被引:18
|
作者
Sharma, Vivek [1 ]
Prakash, Neelam R. [2 ]
Kalra, Parveen [3 ]
机构
[1] PEC Univ & Technol, Ctr Excellence Ind & Prod Design, Chandigarh, India
[2] PEC Univ & Technol, Dept Elect & Commun Engn, Chandigarh, India
[3] PEC Univ & Technol, Dept Prod & Ind Engn, Chandigarh, India
关键词
Affective computing; Multilayer neural networks; Electrodermal activity; Music videos; SKIN-CONDUCTANCE; FEATURE-EXTRACTION; RECOGNITION; CLASSIFICATION;
D O I
10.1016/j.bspc.2018.08.024
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
In this paper, a machine learning algorithm is proposed for emotional pattern recognition during audiovisual stimuli (music videos) using Electrodermal Activity (EDA). For emotion prediction apart from conventional time domain features of EDA signal, various features in different signal representation i.e. frequency and wavelet were analysed. The comparative result indicated that the wavelet features subset outperformed the conventional time domain features in term of classification accuracy. For identification of optimal network configuration, various combination of optimization algorithms (i.e. backpropagation algorithms) and error function were explored. The best performance of 79% for arousal, 69.8% for valence and 71.2% for dominance were obtained for emotion recognition respectively. (C) 2018 Elsevier Ltd. All rights reserved.
引用
收藏
页码:324 / 333
页数:10
相关论文
共 50 条
  • [1] An Audio-video Summarization Scheme Based on Audio and Video Analysis
    Furini, Marco
    Ghini, Vittorio
    2006 3RD IEEE CONSUMER COMMUNICATIONS AND NETWORKING CONFERENCE, VOLS 1-3, 2006, : 1209 - +
  • [2] Audio-Video based Segmentation and Classification Using SVM
    Subashini, K.
    Palanivel, S.
    Ramaligam, V.
    2012 THIRD INTERNATIONAL CONFERENCE ON COMPUTING COMMUNICATION & NETWORKING TECHNOLOGIES (ICCCNT), 2012,
  • [3] Segmentation of news videos based on audio-video information
    De Santo, Massimo
    Percannella, Gennaro
    Sansone, Carlo
    Vento, Mario
    PATTERN ANALYSIS AND APPLICATIONS, 2007, 10 (02) : 135 - 145
  • [4] Audio-Video Synchronization Method Based on Playback Time
    Fu, Jiabing
    Yu, Hewei
    MECHATRONICS AND APPLIED MECHANICS II, PTS 1 AND 2, 2013, 300-301 : 1677 - 1680
  • [5] Segmentation of news videos based on audio-video information
    Massimo De Santo
    Gennaro Percannella
    Carlo Sansone
    Mario Vento
    Pattern Analysis and Applications, 2007, 10 : 135 - 145
  • [6] Audiovisual Saliency Prediction in Uncategorized Video Sequences based on Audio-Video Correlation
    Butt, Maryam Qamar
    Rahman, Anis Ur
    PERCEPTION, 2021, 50 (1_SUPPL) : 161 - 161
  • [7] Design of Audio-Video Player System Based on Android Platform
    Li, Xiangjun
    Ma, Qiaozheng
    Zhang, Xiaofei
    MANUFACTURING PROCESS AND EQUIPMENT, PTS 1-4, 2013, 694-697 : 2313 - +
  • [8] Hierarchical structure for audio-video based semantic classification of sports video sequences
    Kolekar, MH
    Sengupta, S
    VISUAL COMMUNICATIONS AND IMAGE PROCESSING 2005, PTS 1-4, 2005, 5960 : 401 - 409
  • [9] Research on Audio-video Materials Managing System Based on Content Management
    Xia Zhiqiang
    ITCS: 2009 INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY AND COMPUTER SCIENCE, PROCEEDINGS, VOL 2, PROCEEDINGS, 2009, : 575 - 578
  • [10] Feasibility of QoS Control Based on QoS Mapping in Audio-Video Transmission over IEEE 802.11 Wireless LANs
    Ito, Yoshihiro
    Tasaka, Shuji
    2006 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, VOLS 1-12, 2006, : 5097 - 5102