Cross-domain facial expression recognition via an intra-category common feature and inter-category Distinction feature fusion network

被引:57
|
作者
Ji, Yanli [1 ]
Hu, Yuhan [1 ]
Yang, Yang [1 ]
Shen, Fumin [1 ]
Shen, Heng Tao [1 ]
机构
[1] Univ Elect Sci & Technol China, Ctr Future Media, Sch Comp Sci Engn, Chengdu, Sichuan, Peoples R China
关键词
Facial expression recognition; Cross-domain recognition; Deep learning; ICID fusion network;
D O I
10.1016/j.neucom.2018.12.037
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Facial expression recognition is crucial for various human-robot interaction applications, which requires facial expression analysis having a broad generalization. However, existing researches focus on the recognition in databases containing a limited number of samples. In this paper, we propose a novel feature fusion network for facial expression recognition in a cross-domain manner in order to realize the facial expression recognition in extensive scenarios. The proposed network consists of an Intra-category Common feature representation (IC) channel and an Inter-category Distinction feature representation (ID) channel for facial expression representation, and finally combine learned features of the two channels for facial expression recognition in cross databases. The IC channel learns the common features of intra-category facial expressions, and the ID channel learns the characteristic features of different categories. We evaluate the proposed approach in various experiment settings for cross-domain recognition, and achieves the state-of-the-art performances. We also evaluate the proposed approach for expression recognition in single databases, and also obtains the outstanding performance in the CK+, MMI, SFEW and RAF databases. (C) 2018 Elsevier B.V. All rights reserved.
引用
收藏
页码:231 / 239
页数:9
相关论文
共 50 条
  • [41] 2D facial expression recognition via 3D reconstruction and feature fusion
    Moeini, Ali
    Faez, Karim
    Sadeghi, Hamid
    Moeini, Hossein
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2016, 35 : 1 - 14
  • [42] Joint adaptive transfer learning network for cross-domain fault diagnosis based on multi-layer feature fusion
    Jiang, Yimin
    Xia, Tangbin
    Wang, Dong
    Zhang, Kaigan
    Xi, Lifeng
    NEUROCOMPUTING, 2022, 487 : 228 - 242
  • [43] Cross-Domain Feature Interaction Network for Stereo Image Quality Assessment Considering Difference Information Guiding Binocular Fusion
    Chang, Yongli
    Yue, Guanghui
    Zhao, Bo
    IEEE TRANSACTIONS ON BROADCASTING, 2025,
  • [44] Semi-supervised cross-domain feature fusion classification network for coastal wetland classification with hyperspectral and LiDAR data
    Guo, Fangming
    Li, Zhongwei
    Meng, Qiao
    Ren, Guangbo
    Wang, Leiquan
    Wang, Jianbu
    Qin, Huawei
    Zhang, Jie
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2023, 120
  • [45] Cross-Domain Facial Expression Recognition by Combining Transfer Learning and Face-Cycle Generative Adversarial Network
    Zhou, Yu
    Yang, Ben
    Liu, Zhenni
    Wang, Qian
    Xiong, Ping
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (42) : 90289 - 90314
  • [46] Cross-Domain Facial Expression Recognition by Combining Transfer Learning and Face-Cycle Generative Adversarial Network
    Zhou, Yu
    Yang, Ben
    Liu, Zhenni
    Wang, Qian
    Xiong, Ping
    Multimedia Tools and Applications, 83 (42): : 90289 - 90314
  • [47] Learn-to-Decompose: Cascaded Decomposition Network for Cross-Domain Few-Shot Facial Expression Recognition
    Zou, Xinyi
    Yan, Yan
    Xue, Jing-Hao
    Chen, Si
    Wang, Hanzi
    COMPUTER VISION, ECCV 2022, PT XIX, 2022, 13679 : 683 - 700
  • [48] Facial Expression Recognition Based on Multi-scale Feature Fusion Convolutional Neural Network and Attention Mechanism
    Wu, Yana
    Jia, Kebin
    Sun, Zhonghua
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2021, PT II, 2021, 13020 : 324 - 335
  • [49] A Siamese Network via Cross-Domain Robust Feature Decoupling for Multi-Source Remote Sensing Image Registration
    Han, Qichao
    Zhi, Xiyang
    Jiang, Shikai
    Chen, Wenbin
    Huang, Yuanxin
    Yu, Lijian
    Zhang, Wei
    REMOTE SENSING, 2025, 17 (04)
  • [50] A lightweight and robust model for engineering cross-domain fault diagnosis via feature fusion-based unsupervised adversarial learning
    Chen, Qitong
    Chen, Liang
    Li, Qi
    Shi, Juanjuan
    Zhu, Zhongkui
    Shen, Changqing
    MEASUREMENT, 2022, 205