Micro-Expression Recognition by Regression Model and Group Sparse Spatio-Temporal Feature Learning

被引:14
|
作者
Lu, Ping [1 ]
Zheng, Wenming [2 ]
Wang, Ziyan [2 ]
Li, Qiang [2 ]
Zong, Yuan [2 ]
Xin, Minghai [2 ]
Wu, Lenan [3 ]
机构
[1] ZTE Corp, Nanjing 210012, Jiangsu, Peoples R China
[2] Southeast Univ, Res Ctr Learning Sci, Key Lab Child Dev & Learning Sci, Minist Educ, Nanjing 210096, Jiangsu, Peoples R China
[3] Southeast Univ, Sch Informat Sci & Engn, Nanjing 210096, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
micro-expression recognition; local binary patterns on three orthogonal planes (LBP-TOP); group sparse least squares regression (GSLSR); LOCAL BINARY PATTERNS;
D O I
10.1587/transinf.2015EDL8221
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this letter, a micro-expression recognition method is investigated by integrating both spatio-temporal facial features and a regression model. To this end, we first perform a multi-scale facial region division for each facial image and then extract a set of local binary patterns on three orthogonal planes ( LBP-TOP) features corresponding to divided facial regions of the micro-expression videos. Furthermore, we use GSLSR model to build the linear regression relationship between the LBP-TOP facial feature vectors and the micro expressions label vectors. Finally, the learned GSLSR model is applied to the prediction of the micro-expression categories for each test micro-expression video. Experiments are conducted on both CASME II and SMIC micro-expression databases to evaluate the performance of the proposed method, and the results demonstrate that the proposed method is better than the baseline micro-expression recognition method.
引用
收藏
页码:1694 / 1697
页数:4
相关论文
共 50 条
  • [11] PASTFNet: a paralleled attention spatio-temporal fusion network for micro-expression recognition
    Tian, Haichen
    Gong, Weijun
    Li, Wei
    Qian, Yurong
    MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2024, 62 (06) : 1911 - 1924
  • [12] Adaptive spatio-temporal attention neural network for crossdatabase micro-expression recognition
    Ran Y.
    ZHENG W.
    ZONG Y.
    LIU J.
    Virtual Reality and Intelligent Hardware, 2023, 5 (02): : 142 - 156
  • [13] Facial Micro-Expression Recognition using Deep Spatio-Temporal Neural Networks
    Zheng, Yufeng
    Blasch, Erik
    SIGNAL PROCESSING, SENSOR/INFORMATION FUSION, AND TARGET RECOGNITION XXXII, 2023, 12547
  • [14] PASTFNet: a paralleled attention spatio-temporal fusion network for micro-expression recognition
    Haichen Tian
    Weijun Gong
    Wei Li
    Yurong Qian
    Medical & Biological Engineering & Computing, 2024, 62 : 1911 - 1924
  • [15] Two-Level Spatio-Temporal Feature Fused Two-Stream Network for Micro-Expression Recognition
    Wang, Zebiao
    Yang, Mingyu
    Jiao, Qingbin
    Xu, Liang
    Han, Bing
    Li, Yuhang
    Tan, Xin
    SENSORS, 2024, 24 (05)
  • [16] Facial micro-expression recognition based on accordion spatio-temporal representation and random forests
    Guermazi, Radhouane
    Ben Abdallah, Taoufik
    Hammami, Mohamed
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2021, 79
  • [17] Short and Long Range Relation Based Spatio-Temporal Transformer for Micro-Expression Recognition
    Zhang, Liangfei
    Hong, Xiaopeng
    Arandjelovic, Ognjen
    Zhao, Guoying
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2022, 13 (04) : 1973 - 1985
  • [18] Efficient Spatio-Temporal Local Binary Patterns for Spontaneous Facial Micro-Expression Recognition
    Wang, Yandan
    See, John
    Phan, Raphael C. -W.
    Oh, Yee-Hui
    PLOS ONE, 2015, 10 (05):
  • [19] Your heart rate betrays you: multimodal learning with spatio-temporal fusion networks for micro-expression recognition
    Zhang, Ren
    He, Ning
    Liu, Shengjie
    Wu, Ying
    Yan, Kang
    He, Yuzhe
    Lu, Ke
    INTERNATIONAL JOURNAL OF MULTIMEDIA INFORMATION RETRIEVAL, 2022, 11 (04) : 553 - 566
  • [20] Your heart rate betrays you: multimodal learning with spatio-temporal fusion networks for micro-expression recognition
    Ren Zhang
    Ning He
    Shengjie Liu
    Ying Wu
    Kang Yan
    Yuzhe He
    Ke Lu
    International Journal of Multimedia Information Retrieval, 2022, 11 : 553 - 566