Face Emotion Recognition From Static Image Based on Convolution Neural Networks

被引:9
|
作者
Nasri, M. A. [1 ,2 ]
Hmani, M. A. [2 ]
Mtibaa, A. [2 ]
Petrovska-Delacretaz, D. [2 ]
Ben Slima, M. [3 ]
Ben Hamida, A. [1 ]
机构
[1] Natl Engn Sch Sfax, Sfax, Tunisia
[2] Telecom SudParis, Paris, France
[3] ENetcom Sfax, Sfax, Tunisia
来源
2020 5TH INTERNATIONAL CONFERENCE ON ADVANCED TECHNOLOGIES FOR SIGNAL AND IMAGE PROCESSING (ATSIP'2020) | 2020年
关键词
Emotions; Facials expression; Recognition; Dee learning; Convolution neural networks;
D O I
10.1109/atsip49331.2020.9231537
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Human-Machine Interaction systems have not yet reached all the emotional and social capacities. In this paper, we propose a face emotion recognition system from static image based on the Xception convolution neural network architecture and the K-fold-cross-validation strategy. The proposed system was improved using the fine-tuning method. The Xception model pre-trained on ImageNet database for objects recognition was fine-tuned to recognize seven emotional states. The proposed system is evaluated on the database recorded during the Empathic project and the AffectNet database. Our experimental results achieve an accuracy of 62%, 69% on Empathic and AffectNet databases respectively using the fine-tuning strategy. Combined the AffectNet and Empathic databases to train our proposed model, show significant improvement in the emotion recognition that achieves an accuracy of 91.2% on Empathic database.
引用
收藏
页数:6
相关论文
共 50 条
  • [21] Multimodal Facial Emotion Recognition Using Improved Convolution Neural Networks Model
    Udeh, Chinonso Paschal
    Chen, Luefeng
    Du, Sheng
    Li, Min
    Wu, Min
    JOURNAL OF ADVANCED COMPUTATIONAL INTELLIGENCE AND INTELLIGENT INFORMATICS, 2023, 27 (04) : 710 - 719
  • [22] LiteEmo: Lightweight Deep Neural Networks for Image Emotion Recognition
    Chew, Yan-Han
    Wong, Lai-Kuan
    See, John
    Khor, Huai-Qian
    Abivishaq, Balasubramanian
    2019 IEEE 21ST INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP 2019), 2019,
  • [23] Multimodal emotion recognition based on manifold learning and convolution neural network
    Zhang, Yong
    Cheng, Cheng
    Zhang, YiDie
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (23) : 33253 - 33268
  • [24] Multimodal emotion recognition based on manifold learning and convolution neural network
    Yong Zhang
    Cheng Cheng
    YiDie Zhang
    Multimedia Tools and Applications, 2022, 81 : 33253 - 33268
  • [25] Comparison of Face Recognition and Detection Models: Using Different Convolution Neural Networks
    Optical Memory and Neural Networks, 2019, 28 : 101 - 108
  • [26] Comparison of Face Recognition and Detection Models: Using Different Convolution Neural Networks
    Kang, Kai
    OPTICAL MEMORY AND NEURAL NETWORKS, 2019, 28 (02) : 101 - 108
  • [27] Automatic face recognition based on neural networks
    Yu, Dongjun
    Xu, Weihong
    Zhao, Haitao
    Yang, Jingyu
    Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2003, 25 (09):
  • [28] A face recognition system based on convolution neural network using multiple distance face
    Moon, Hae-Min
    Seo, Chang Ho
    Pan, Sung Bum
    SOFT COMPUTING, 2017, 21 (17) : 4995 - 5002
  • [29] Research on Optimization of static gesture recognition based on convolution Neural Network
    Xing, Guo
    Wu, Xu
    Quan, Tang Wen
    Cong, Wen
    2019 4TH INTERNATIONAL CONFERENCE ON MECHANICAL, CONTROL AND COMPUTER ENGINEERING (ICMCCE 2019), 2019, : 398 - 400
  • [30] A face recognition system based on convolution neural network using multiple distance face
    Hae-Min Moon
    Chang Ho Seo
    Sung Bum Pan
    Soft Computing, 2017, 21 : 4995 - 5002