Emotion recognition and interaction of smart education environment screen based on deep learning networks

被引:0
|
作者
Zhao, Wei [1 ]
Qiu, Liguo [1 ]
机构
[1] Hunan Coll Informat, Dept Informat Engn, Changsha 410200, Peoples R China
关键词
deep neural network; MTCNN; 3D-CNN; intelligent education; emotion recognition;
D O I
10.1515/jisys-2024-0082
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Smart education environments combine technologies such as big data, cloud computing, and artificial intelligence to optimize and personalize the teaching and learning process, thereby improving the efficiency and quality of education. This article proposes a dual-stream-coded image sentiment analysis method based on both facial expressions and background actions to monitor and analyze learners' behaviors in real time. By integrating human facial expressions and scene backgrounds, the method can effectively address the occlusion problem in uncontrolled environments. To enhance the accuracy and efficiency of emotion recognition, a multi-task convolutional network is employed for face extraction, while 3D convolutional neural networks optimize the extraction process of facial features. Additionally, the adaptive learning screen adjustment system proposed in this article dynamically adjusts the presentation of learning content to optimize the learning environment and enhance learning efficiency by monitoring learners' expressions and reactions in real time. By analyzing the experimental results on the Emotic dataset, the emotion recognition model in this article shows high accuracy, especially in the recognition of specific emotion categories. This research significantly contributes to the field of smart education environments by providing an effective solution for real-time emotion recognition.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Deep Learning for EEG-based Emotion Recognition: A Survey
    Li J.-Y.
    Du X.-B.
    Zhu Z.-L.
    Deng X.-M.
    Ma C.-X.
    Wang H.-A.
    Ruan Jian Xue Bao/Journal of Software, 2023, 34 (01): : 255 - 276
  • [32] Research on multimedia emotion modeling and recognition based on deep learning
    Li, Ronghao
    Zhang, Tao
    Xiong, Yuhan
    BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, 2021, 128 : 183 - 183
  • [33] Emotion recognition of social media users based on deep learning
    Li, Chen
    Li, Fanfan
    PEERJ COMPUTER SCIENCE, 2023, 9
  • [34] Feature Fusion of Speech Emotion Recognition Based on Deep Learning
    Liu, Gang
    He, Wei
    Jin, Bicheng
    PROCEEDINGS OF 2018 INTERNATIONAL CONFERENCE ON NETWORK INFRASTRUCTURE AND DIGITAL CONTENT (IEEE IC-NIDC), 2018, : 193 - 197
  • [35] Emotion recognition algorithm of basketball players based on deep learning
    Zhou L.
    Zhang C.
    Wang M.
    International Journal of Information and Communication Technology, 2023, 22 (04) : 377 - 390
  • [36] Deep learning based Intelligent Emotion Recognition and Classification System
    Khan, Misha Urooj
    Saeed, Zubair
    Raza, Ali
    Abbasi, Muhammad Abdullah
    Asif, Muneeb
    Urooj
    2021 INTERNATIONAL CONFERENCE ON FRONTIERS OF INFORMATION TECHNOLOGY (FIT 2021), 2021, : 25 - 30
  • [37] Deep Learning for Emotion Recognition in Faces
    Ruiz-Garcia, Ariel
    Elshaw, Mark
    Altahhan, Abdulrahman
    Palade, Vasile
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2016, PT II, 2016, 9887 : 38 - 46
  • [38] Speech Emotion Recognition with Deep Learning
    Harar, Pavol
    Burget, Radim
    Dutta, Malay Kishore
    2017 4TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND INTEGRATED NETWORKS (SPIN), 2017, : 137 - 140
  • [39] EMOTION RECOGNITION USING DEEP LEARNING
    Priya, R. N. Beena
    Hanmandlu, M.
    Vasikarla, Shantaram
    2021 IEEE APPLIED IMAGERY PATTERN RECOGNITION WORKSHOP (AIPR), 2021,
  • [40] Design of smart home system speech emotion recognition model based on ensemble deep learning and feature fusion
    Wang, Mengsheng
    Ma, Hongbin
    Wang, Yingli
    Sun, Xianhe
    APPLIED ACOUSTICS, 2024, 218