Emotion recognition and interaction of smart education environment screen based on deep learning networks

被引:0
|
作者
Zhao, Wei [1 ]
Qiu, Liguo [1 ]
机构
[1] Hunan Coll Informat, Dept Informat Engn, Changsha 410200, Peoples R China
关键词
deep neural network; MTCNN; 3D-CNN; intelligent education; emotion recognition;
D O I
10.1515/jisys-2024-0082
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Smart education environments combine technologies such as big data, cloud computing, and artificial intelligence to optimize and personalize the teaching and learning process, thereby improving the efficiency and quality of education. This article proposes a dual-stream-coded image sentiment analysis method based on both facial expressions and background actions to monitor and analyze learners' behaviors in real time. By integrating human facial expressions and scene backgrounds, the method can effectively address the occlusion problem in uncontrolled environments. To enhance the accuracy and efficiency of emotion recognition, a multi-task convolutional network is employed for face extraction, while 3D convolutional neural networks optimize the extraction process of facial features. Additionally, the adaptive learning screen adjustment system proposed in this article dynamically adjusts the presentation of learning content to optimize the learning environment and enhance learning efficiency by monitoring learners' expressions and reactions in real time. By analyzing the experimental results on the Emotic dataset, the emotion recognition model in this article shows high accuracy, especially in the recognition of specific emotion categories. This research significantly contributes to the field of smart education environments by providing an effective solution for real-time emotion recognition.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Deep Learning Based Audio-Visual Emotion Recognition in a Smart Learning Environment
    Ivleva, Natalja
    Pentel, Avar
    Dunajeva, Olga
    Justsenko, Valeria
    TOWARDS A HYBRID, FLEXIBLE AND SOCIALLY ENGAGED HIGHER EDUCATION, VOL 1, ICL 2023, 2024, 899 : 420 - 431
  • [2] Smart Doll: Emotion Recognition Using Embedded Deep Learning
    Luis Espinosa-Aranda, Jose
    Vallez, Noelia
    Maria Rico-Saavedra, Jose
    Parra-Patino, Javier
    Bueno, Gloria
    Sorci, Matteo
    Moloney, David
    Pena, Dexmont
    Deniz, Oscar
    SYMMETRY-BASEL, 2018, 10 (09):
  • [3] Emotion Recognition Based on Handwriting Using Generative Adversarial Networks and Deep Learning
    Qi, Hengnian
    Zeng, Gang
    Jia, Keke
    Zhang, Chu
    Wu, Xiaoping
    Li, Mengxia
    Lang, Qing
    Wang, Lingxuan
    IET BIOMETRICS, 2024, 2024
  • [4] Deep Learning and Audio Based Emotion Recognition
    Demir, Asli
    Atila, Orhan
    Sengur, Abdulkadir
    2019 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND DATA PROCESSING (IDAP 2019), 2019,
  • [5] Deep learning-based facial emotion recognition for human–computer interaction applications
    M. Kalpana Chowdary
    Tu N. Nguyen
    D. Jude Hemanth
    Neural Computing and Applications, 2023, 35 : 23311 - 23328
  • [6] Machine Learning Based Emotion Recognition in a Digital Learning Environment
    Ivleva, Natalja
    Pentel, Avar
    Dunajeva, Olga
    Justsenko, Valeria
    LEARNING IN THE AGE OF DIGITAL AND GREEN TRANSITION, ICL2022, VOL 1, 2023, 633 : 405 - 412
  • [7] Music Emotion Recognition Based on Deep Learning: A Review
    Jiang, Xingguo
    Zhang, Yuchao
    Lin, Guojun
    Yu, Ling
    IEEE ACCESS, 2024, 12 : 157716 - 157745
  • [8] Respiration-based emotion recognition with deep learning
    Zhang, Qiang
    Chen, Xianxiang
    Zhan, Qingyuan
    Yang, Ting
    Xia, Shanhong
    COMPUTERS IN INDUSTRY, 2017, 92-93 : 84 - 90
  • [9] Deep Learning Based Facial Emotion Recognition System
    Ozdemir, Mehmet Akif
    Elagoz, Berkay
    Soy, Aysegul Alaybeyoglu
    Akan, Aydin
    2020 MEDICAL TECHNOLOGIES CONGRESS (TIPTEKNO), 2020,
  • [10] Deep Learning based Emotion Recognition IoT System
    Yokoo, Kentaro
    Atsumi, Masahiko
    Tanaka, Kei
    Wang, Haoqing
    Meng, Lin
    2020 INTERNATIONAL CONFERENCE ON ADVANCED MECHATRONIC SYSTEMS (ICAMECHS), 2020, : 203 - 207