Cross-domain facial expression recognition via an intra-category common feature and inter-category Distinction feature fusion network

被引:57
|
作者
Ji, Yanli [1 ]
Hu, Yuhan [1 ]
Yang, Yang [1 ]
Shen, Fumin [1 ]
Shen, Heng Tao [1 ]
机构
[1] Univ Elect Sci & Technol China, Ctr Future Media, Sch Comp Sci Engn, Chengdu, Sichuan, Peoples R China
关键词
Facial expression recognition; Cross-domain recognition; Deep learning; ICID fusion network;
D O I
10.1016/j.neucom.2018.12.037
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Facial expression recognition is crucial for various human-robot interaction applications, which requires facial expression analysis having a broad generalization. However, existing researches focus on the recognition in databases containing a limited number of samples. In this paper, we propose a novel feature fusion network for facial expression recognition in a cross-domain manner in order to realize the facial expression recognition in extensive scenarios. The proposed network consists of an Intra-category Common feature representation (IC) channel and an Inter-category Distinction feature representation (ID) channel for facial expression representation, and finally combine learned features of the two channels for facial expression recognition in cross databases. The IC channel learns the common features of intra-category facial expressions, and the ID channel learns the characteristic features of different categories. We evaluate the proposed approach in various experiment settings for cross-domain recognition, and achieves the state-of-the-art performances. We also evaluate the proposed approach for expression recognition in single databases, and also obtains the outstanding performance in the CK+, MMI, SFEW and RAF databases. (C) 2018 Elsevier B.V. All rights reserved.
引用
收藏
页码:231 / 239
页数:9
相关论文
共 50 条
  • [31] Cross-domain facial expression recognition: Bi-Directional Fusion of Active and Stable Information
    Zhu, Yanan
    Ai, Jiaqiu
    Xue, Weibao
    Wu, Mingyang
    Yang, Sen
    Jia, Wei
    Hu, Min
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2025, 149
  • [32] CC-CNN: A cross connected convolutional neural network using feature level fusion for facial expression recognition
    Kadimi Naveen Kumar Tataji
    Mukku Nisanth Kartheek
    Munaga V. N. K. Prasad
    Multimedia Tools and Applications, 2024, 83 : 27619 - 27645
  • [33] CC-CNN: A cross connected convolutional neural network using feature level fusion for facial expression recognition
    Kumar Tataji, Kadimi Naveen
    Kartheek, Mukku Nisanth
    Prasad, Munaga V. N. K.
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (09) : 27619 - 27645
  • [34] A new multi-feature fusion based convolutional neural network for facial expression recognition
    Zou, Wei
    Zhang, Dong
    Lee, Dah-Jye
    APPLIED INTELLIGENCE, 2022, 52 (03) : 2918 - 2929
  • [35] A new multi-feature fusion based convolutional neural network for facial expression recognition
    Wei Zou
    Dong Zhang
    Dah-Jye Lee
    Applied Intelligence, 2022, 52 : 2918 - 2929
  • [36] Attention-Rectified and Texture-Enhanced Cross-Attention Transformer Feature Fusion Network for Facial Expression Recognition
    Sun, Mingyi
    Cui, Weigang
    Zhang, Yue
    Yu, Shuyue
    Liao, Xiaofeng
    Hu, Bin
    Li, Yang
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (12) : 11823 - 11832
  • [37] CF-GAN: cross-domain feature fusion generative adversarial network for text-to-image synthesis
    Zhang, Yubo
    Han, Shuang
    Zhang, Zhongxin
    Wang, Jianyang
    Bi, Hongbo
    VISUAL COMPUTER, 2023, 39 (04): : 1283 - 1293
  • [38] CFI-LFENet: Infusing cross-domain fusion image and lightweight feature enhanced network for fault diagnosis
    Lian, Chao
    Zhao, Yuliang
    Shao, Jinliang
    Sun, Tianang
    Dong, Fanghecong
    Ju, Zhongjie
    Zhan, Zhikun
    Shan, Peng
    INFORMATION FUSION, 2024, 104
  • [39] CF-GAN: cross-domain feature fusion generative adversarial network for text-to-image synthesis
    Yubo Zhang
    Shuang Han
    Zhongxin Zhang
    Jianyang Wang
    Hongbo Bi
    The Visual Computer, 2023, 39 : 1283 - 1293
  • [40] Multi-level feature fusion capsule network with self-attention for facial expression recognition
    Huang, Zhiji
    Yu, Songsen
    Liang, Jun
    JOURNAL OF ELECTRONIC IMAGING, 2023, 32 (02)