Micro-Expression Recognition by Regression Model and Group Sparse Spatio-Temporal Feature Learning

被引:14
|
作者
Lu, Ping [1 ]
Zheng, Wenming [2 ]
Wang, Ziyan [2 ]
Li, Qiang [2 ]
Zong, Yuan [2 ]
Xin, Minghai [2 ]
Wu, Lenan [3 ]
机构
[1] ZTE Corp, Nanjing 210012, Jiangsu, Peoples R China
[2] Southeast Univ, Res Ctr Learning Sci, Key Lab Child Dev & Learning Sci, Minist Educ, Nanjing 210096, Jiangsu, Peoples R China
[3] Southeast Univ, Sch Informat Sci & Engn, Nanjing 210096, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
micro-expression recognition; local binary patterns on three orthogonal planes (LBP-TOP); group sparse least squares regression (GSLSR); LOCAL BINARY PATTERNS;
D O I
10.1587/transinf.2015EDL8221
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this letter, a micro-expression recognition method is investigated by integrating both spatio-temporal facial features and a regression model. To this end, we first perform a multi-scale facial region division for each facial image and then extract a set of local binary patterns on three orthogonal planes ( LBP-TOP) features corresponding to divided facial regions of the micro-expression videos. Furthermore, we use GSLSR model to build the linear regression relationship between the LBP-TOP facial feature vectors and the micro expressions label vectors. Finally, the learned GSLSR model is applied to the prediction of the micro-expression categories for each test micro-expression video. Experiments are conducted on both CASME II and SMIC micro-expression databases to evaluate the performance of the proposed method, and the results demonstrate that the proposed method is better than the baseline micro-expression recognition method.
引用
收藏
页码:1694 / 1697
页数:4
相关论文
共 50 条
  • [1] MICRO-EXPRESSION RECOGNITION BASED ON THE SPATIO-TEMPORAL FEATURE
    Su, Wenchao
    Wang, Yanyan
    Su, Fei
    Zhao, Zhicheng
    2018 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW 2018), 2018,
  • [2] Micro-Expression Recognition Based on Spatio-Temporal Feature Extraction of Key Regions
    Zhu, Wenqiu
    Li, Yongsheng
    Liu, Qiang
    Zeng, Zhigao
    CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 77 (01): : 1373 - 1392
  • [3] Micro-Expression Recognition with Expression-State Constrained Spatio-Temporal Feature Representations
    Kim, Dae Hoe
    Baddar, Wissam J.
    Ro, Yong Man
    MM'16: PROCEEDINGS OF THE 2016 ACM MULTIMEDIA CONFERENCE, 2016, : 382 - 386
  • [4] Micro-Expression Recognition Based on Spatio-Temporal Capsule Network
    Shang, Ziyang
    Liu, Jie
    Li, Xinfu
    IEEE ACCESS, 2023, 11 : 13704 - 13713
  • [5] Micro-Expression Recognition by Aggregating Local Spatio-Temporal Patterns
    Zhang, Shiyu
    Feng, Bailan
    Chen, Zhineng
    Huang, Xiangsheng
    MULTIMEDIA MODELING (MMM 2017), PT I, 2017, 10132 : 638 - 648
  • [6] Sparse MDMO: Learning a Discriminative Feature for Micro-Expression Recognition
    Liu, Yong-Jin
    Li, Bing-Jun
    Lai, Yu-Kun
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2021, 12 (01) : 254 - 261
  • [7] Evaluation of the Spatio-Temporal Features and GAN for Micro-Expression Recognition System
    Liong, Sze-Teng
    Gan, Y. S.
    Zheng, Danna
    Li, Shu-Meng
    Xu, Hao-Xuan
    Zhang, Han-Zhe
    Lyu, Ran-Ke
    Liu, Kun-Hong
    JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY, 2020, 92 (07): : 705 - 725
  • [8] Evaluation of the Spatio-Temporal Features and GAN for Micro-Expression Recognition System
    Sze-Teng Liong
    Y. S. Gan
    Danna Zheng
    Shu-Meng Li
    Hao-Xuan Xu
    Han-Zhe Zhang
    Ran-Ke Lyu
    Kun-Hong Liu
    Journal of Signal Processing Systems, 2020, 92 : 705 - 725
  • [9] Group Sparse Reduced Rank Tensor Regression for Micro-Expression Recognition
    Li, Sunan
    Zong, Yuan
    Lu, Cheng
    Tang, Chuangan
    Zhao, Yan
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2023, E106D (04) : 575 - 578
  • [10] Two-tiered Spatio-temporal Feature Extraction for Micro-expression Classification
    Jain, Ankita
    Bhakta, Dhananjoy
    Dey, Prasenjit
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2025, 109