Cross-Domain Facial Expression Recognition Based on Transductive Deep Transfer Learning

被引:59
|
作者
Yan, Keyu [1 ,2 ]
Zheng, Wenming [1 ]
Zhang, Tong [3 ]
Zong, Yuan [1 ]
Tang, Chuangao [1 ]
Lu, Cheng [1 ,2 ]
Cui, Zhen [3 ]
机构
[1] Southeast Univ, Sch Biol Sci & Med Engn, Key Lab Child Dev & Learning Sci, Minist Educ, Nanjing 210096, Jiangsu, Peoples R China
[2] Southeast Univ, Sch Informat Sci & Engn, Nanjing 210096, Jiangsu, Peoples R China
[3] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Cross-domain facial expression recognition; transductive transfer learning; VGGFace16-Net; KERNEL;
D O I
10.1109/ACCESS.2019.2930359
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we proposed a novel end-to-end transductive deep transfer learning network (TDTLN) to deal with the challenging cross-domain expression recognition problem, in which both the source and target databases are utilized to jointly learn optimal nonlinear discriminative features so as to improve the label prediction performance of the target data samples. As part of the network parameters, the labels of the target samples are also optimized when optimizing the parameters of TDTLN, such that the cross-entropy loss of source domain data and the regression loss of target domain data can be simultaneously calculated. Finally, to evaluate the recognition performance of the proposed TDTLN method, we conduct extensive cross-database experiments on four commonly used multi-view facial expression databases, namely the BU-3DEF, Multi-PIE, SFEW, and RAF database. The experimental results show that the proposed TDTLN method outperforms state-of-the-art methods.
引用
收藏
页码:108906 / 108915
页数:10
相关论文
共 50 条
  • [1] Cross-Domain Color Facial Expression Recognition Using Transductive Transfer Subspace Learning
    Zheng, Wenming
    Zong, Yuan
    Zhou, Xiaoyan
    Xin, Minghai
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2018, 9 (01) : 21 - 37
  • [2] Cross-Domain Knowledge Transfer for Incremental Deep Learning in Facial Expression Recognition
    Sugianto, Nehemia
    Tjondronegoro, Dian
    2019 7TH INTERNATIONAL CONFERENCE ON ROBOT INTELLIGENCE TECHNOLOGY AND APPLICATIONS (RITA), 2019, : 205 - 209
  • [3] Deep Transfer Learning for Cross-domain Activity Recognition
    Wang, Jindong
    Zheng, Vincent W.
    Chen, Yiqiang
    Huang, Meiyu
    PROCEEDINGS OF THE 3RD INTERNATIONAL CONFERENCE ON CROWD SCIENCE AND ENGINEERING (ICCSE 2018), 2018,
  • [4] Deep Margin-Sensitive Representation Learning for Cross-Domain Facial Expression Recognition
    Li, Yingjian
    Zhang, Zheng
    Chen, Bingzhi
    Lu, Guangming
    Zhang, David
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 1359 - 1373
  • [5] Transfer Model Collaborating Metric Learning and Dictionary Learning for Cross-Domain Facial Expression Recognition
    Ni, Tongguang
    Zhang, Cong
    Gu, Xiaoqing
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2021, 8 (05) : 1213 - 1222
  • [6] Cross-Domain Sample Relationship Learning for Facial Expression Recognition
    Chen, Dongliang
    Wen, Guihua
    Wen, Pengcheng
    Yang, Pei
    Chen, Rui
    Li, Cheng
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 3788 - 3798
  • [7] Cross-Domain Expression Recognition Based on Sparse Coding and Transfer Learning
    Yang, Yong
    Zhang, Weiyi
    Huang, Yong
    MATERIALS SCIENCE, ENERGY TECHNOLOGY, AND POWER ENGINEERING I, 2017, 1839
  • [8] Deep cross-domain transfer for emotion recognition via joint learning
    Nguyen, Dung
    Nguyen, Duc Thanh
    Sridharan, Sridha
    Abdelrazek, Mohamed
    Denman, Simon
    Tran, Son N.
    Zeng, Rui
    Fookes, Clinton
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (8) : 22455 - 22472
  • [9] Deep cross-domain transfer for emotion recognition via joint learning
    Dung Nguyen
    Duc Thanh Nguyen
    Sridha Sridharan
    Mohamed Abdelrazek
    Simon Denman
    Son N. Tran
    Rui Zeng
    Clinton Fookes
    Multimedia Tools and Applications, 2024, 83 : 22455 - 22472
  • [10] Cross-domain facial expression recognition based on adversarial attack fine-tuning learning
    Zhang, Yingrui
    Sun, Zhe
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 136