Emotion recognition and interaction of smart education environment screen based on deep learning networks

被引:0
|
作者
Zhao, Wei [1 ]
Qiu, Liguo [1 ]
机构
[1] Hunan Coll Informat, Dept Informat Engn, Changsha 410200, Peoples R China
关键词
deep neural network; MTCNN; 3D-CNN; intelligent education; emotion recognition;
D O I
10.1515/jisys-2024-0082
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Smart education environments combine technologies such as big data, cloud computing, and artificial intelligence to optimize and personalize the teaching and learning process, thereby improving the efficiency and quality of education. This article proposes a dual-stream-coded image sentiment analysis method based on both facial expressions and background actions to monitor and analyze learners' behaviors in real time. By integrating human facial expressions and scene backgrounds, the method can effectively address the occlusion problem in uncontrolled environments. To enhance the accuracy and efficiency of emotion recognition, a multi-task convolutional network is employed for face extraction, while 3D convolutional neural networks optimize the extraction process of facial features. Additionally, the adaptive learning screen adjustment system proposed in this article dynamically adjusts the presentation of learning content to optimize the learning environment and enhance learning efficiency by monitoring learners' expressions and reactions in real time. By analyzing the experimental results on the Emotic dataset, the emotion recognition model in this article shows high accuracy, especially in the recognition of specific emotion categories. This research significantly contributes to the field of smart education environments by providing an effective solution for real-time emotion recognition.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Towards Integrating Automatic Emotion Recognition in Education: A Deep Learning Model Based on 5 EEG Channels
    Moise, Gabriela
    Dragomir, Elia Georgiana
    Schiopu, Daniela
    Iancu, Lidia Angelica
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2024, 17 (01)
  • [42] From Smart to Personal Environment: Integrating Emotion Recognition into Smart Houses
    Fedotov, Dmitrii
    Matsuda, Yuki
    Minker, Wolfgang
    2019 IEEE INTERNATIONAL CONFERENCE ON PERVASIVE COMPUTING AND COMMUNICATIONS WORKSHOPS (PERCOM WORKSHOPS), 2019, : 943 - 948
  • [43] Deep features-based speech emotion recognition for smart affective services
    Badshah, Abdul Malik
    Rahim, Nasir
    Ullah, Noor
    Ahmad, Jamil
    Muhammad, Khan
    Lee, Mi Young
    Kwon, Soonil
    Baik, Sung Wook
    MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (05) : 5571 - 5589
  • [44] Emotion Recognition of College Students' Online Learning Engagement Based on Deep Learning
    Wang, Chunyan
    INTERNATIONAL JOURNAL OF EMERGING TECHNOLOGIES IN LEARNING, 2022, 17 (06) : 110 - 122
  • [45] Deep features-based speech emotion recognition for smart affective services
    Abdul Malik Badshah
    Nasir Rahim
    Noor Ullah
    Jamil Ahmad
    Khan Muhammad
    Mi Young Lee
    Soonil Kwon
    Sung Wook Baik
    Multimedia Tools and Applications, 2019, 78 : 5571 - 5589
  • [46] Emotion Regulation and Performance Enhancement in College Athletes Based on Emotion Recognition and Deep Learning
    Li, Haiqing
    REVISTA INTERNACIONAL DE MEDICINA Y CIENCIAS DE LA ACTIVIDAD FISICA Y DEL DEPORTE, 2022, 22 (86): : 476 - 492
  • [47] Learning Deep Binaural Representations With Deep Convolutional Neural Networks for Spontaneous Speech Emotion Recognition
    Zhang, Shiqing
    Chen, Aihua
    Guo, Wenping
    Cui, Yueli
    Zhao, Xiaoming
    Liu, Limei
    IEEE ACCESS, 2020, 8 : 23496 - 23505
  • [48] EEG-based emotion recognition with deep convolutional neural networks
    Ozdemir, Mehmet Akif
    Degirmenci, Murside
    Izci, Elf
    Akan, Aydin
    BIOMEDICAL ENGINEERING-BIOMEDIZINISCHE TECHNIK, 2021, 66 (01): : 43 - 57
  • [49] Improvement on Speech Emotion Recognition Based on Deep Convolutional Neural Networks
    Niu, Yafeng
    Zou, Dongsheng
    Niu, Yadong
    He, Zhongshi
    Tan, Hua
    PROCEEDINGS OF 2018 INTERNATIONAL CONFERENCE ON COMPUTING AND ARTIFICIAL INTELLIGENCE (ICCAI 2018), 2018, : 13 - 18
  • [50] Multimodal Emotion Recognition Using Deep Networks
    Fadil, C.
    Alvarez, R.
    Martinez, C.
    Goddard, J.
    Rufiner, H.
    VI LATIN AMERICAN CONGRESS ON BIOMEDICAL ENGINEERING (CLAIB 2014), 2014, 49 : 813 - 816