A Micro-expression Recognition Algorithm for Students in Classroom Learning Based on Convolutional Neural Network

被引:34
|
作者
Pei, Jiayin [1 ]
Shan, Peng [1 ]
机构
[1] Jiangnan Univ, Sch Business, Wuxi 214122, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
convolutional neural network (CNN); micro-expression recognition; deep learning; face detection; classroom learning; FACIAL EXPRESSION; POSITIVE EMOTIONS;
D O I
10.18280/ts.360611
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In classroom teaching, the teachers should adjust the teaching strategy and improve the teaching effect based on the expression and learning state of each student. This paper mainly develops a micro-expression recognition algorithm for students in classroom learning, based on convolutional neural network (CNN) and automatic face detection. Specifically, the multitask deep convolution network (DNN) was adopted to detect the landmark points of human face, and a hybrid DNN was designed to extract the optical-flow features of micro-expression. The extracted features were improved through redundancy removal and dimensionality reduction. The rationality of our algorithm was proved through a comparative experiment on real-world databases and an application in classroom teaching. The research results provide a new direction for applying deep learning in face recognition.
引用
收藏
页码:557 / 563
页数:7
相关论文
共 50 条
  • [21] Evaluation of teaching effectiveness based on classroom micro-expression recognition
    Guo X.
    Zhou J.
    Xu T.
    International Journal of Performability Engineering, 2018, 14 (11) : 2877 - 2885
  • [22] Spontaneous Facial Micro-expression Recognition via Deep Convolutional Network
    Xia, Zhaoqiang
    Feng, Xiaoyi
    Hong, Xiaopeng
    Zhao, Guoying
    2018 EIGHTH INTERNATIONAL CONFERENCE ON IMAGE PROCESSING THEORY, TOOLS AND APPLICATIONS (IPTA), 2018, : 235 - 240
  • [23] Micro-expression recognition with small sample size by transferring long-term convolutional neural network
    Wang, Su-Jing
    Li, Bing-Jun
    Liu, Yong-Jin
    Yan, Wen-Jing
    Ou, Xinyu
    Huang, Xiaohua
    Xu, Feng
    Fu, Xiaolan
    NEUROCOMPUTING, 2018, 312 : 251 - 262
  • [24] A Review of Micro-expression Recognition based on Deep Learning
    Zhang, He
    Zhang, Hanling
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [25] Micro-Expression Recognition Algorithm Based on 3D Convolutional Neural Network and Optical Flow Fields from Neighboring Frames of Apex Frame
    Zhang, Xuesen
    Jia, Jingping
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2021, 34 (05): : 423 - 433
  • [26] AU-assisted Graph Attention Convolutional Network for Micro-Expression Recognition
    Xie, Hong-Xia
    Lo, Ling
    Shuai, Hong-Han
    Cheng, Wen-Huang
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 2871 - 2880
  • [27] Fusion Network Based on Motion Learning and Image Feature Representation for Micro-Expression Recognition
    Wang, Xiaojia
    Zhang, Mingliang
    Li, Bin
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT XI, 2025, 15041 : 549 - 562
  • [28] Research on Facial Expression Recognition Algorithm Based on Convolutional Neural Network
    Zhang, Xiaobo
    Yang, Yuliang
    Zhang, Linhao
    Li, Wanchong
    Dang, Shuai
    Wang, Peng
    Zhu, Mengyu
    2019 28TH WIRELESS AND OPTICAL COMMUNICATIONS CONFERENCE (WOCC), 2019, : 271 - 275
  • [29] Micro-expression Analysis by Fusing Deep Convolutional Neural Network and Optical Flow
    Li, Qiuyu
    Yu, Jun
    Kurihara, Toru
    Zhan, Shu
    2018 5TH INTERNATIONAL CONFERENCE ON CONTROL, DECISION AND INFORMATION TECHNOLOGIES (CODIT), 2018, : 265 - 270
  • [30] MERASTC: Micro-Expression Recognition Using Effective Feature Encodings and 2D Convolutional Neural Network
    Gupta, Puneet
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2023, 14 (02) : 1431 - 1441