Realtime Emotional Reflective User Interface Based on Deep Convolutional Neural Networks and Generative Adversarial Networks

被引:4
|
作者
Burrows, Holly [1 ]
Zarrin, Javad [1 ]
Babu-Saheer, Lakshmi [1 ]
Maktab-Dar-Oghaz, Mahdi [1 ]
机构
[1] Anglia Ruskin Univ, Sch Comp & Informat Sci, East Rd, Cambridge CB1 1PT, England
关键词
emotion recognition; deep learning; CNN; GAN; intelligent user interface; human computer interaction; mental health;
D O I
10.3390/electronics11010118
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
It is becoming increasingly apparent that a significant amount of the population suffers from mental health problems, such as stress, depression, and anxiety. These issues are a result of a vast range of factors, such as genetic conditions, social circumstances, and lifestyle influences. A key cause, or contributor, for many people is their work; poor mental state can be exacerbated by jobs and a person's working environment. Additionally, as the information age continues to burgeon, people are increasingly sedentary in their working lives, spending more of their days seated, and less time moving around. It is a well-known fact that a decrease in physical activity is detrimental to mental well-being. Therefore, the need for innovative research and development to combat negativity early is required. Implementing solutions using Artificial Intelligence has great potential in this field of research. This work proposes a solution to this problem domain, utilising two concepts of Artificial Intelligence, namely, Convolutional Neural Networks and Generative Adversarial Networks. A CNN is trained to accurately predict when an individual is experiencing negative emotions, achieving a top accuracy of 80.38% with a loss of 0.42. A GAN is trained to synthesise images from an input domain that can be attributed to evoking position emotions. A Graphical User Interface is created to display the generated media to users in order to boost mood and reduce feelings of stress. The work demonstrates the capability for using Deep Learning to identify stress and negative mood, and the strategies that can be implemented to reduce them.
引用
收藏
页数:26
相关论文
共 50 条
  • [21] Optimization of microscopy image compression using convolutional neural networks and removal of artifacts by deep generative adversarial networks
    Paul, Raj Kumar
    Misra, Dipankar
    Sen, Shibaprasad
    Chandran, Saravanan
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (20) : 58961 - 58980
  • [22] Deep learning-based stochastic ground motion modeling using generative adversarial and convolutional neural networks
    Masoudifar, Mohsen
    Mahsuli, Mojtaba
    Taciroglu, Ertugrul
    SOIL DYNAMICS AND EARTHQUAKE ENGINEERING, 2025, 194
  • [23] ARGAN: Adversarially Robust Generative Adversarial Networks for Deep Neural Networks Against Adversarial Examples
    Choi, Seok-Hwan
    Shin, Jin-Myeong
    Liu, Peng
    Choi, Yoon-Ho
    IEEE ACCESS, 2022, 10 : 33602 - 33615
  • [24] ARGAN: Adversarially Robust Generative Adversarial Networks for Deep Neural Networks Against Adversarial Examples
    Choi, Seok-Hwan
    Shin, Jin-Myeong
    Liu, Peng
    Choi, Yoon-Ho
    IEEE Access, 2022, 10 : 33602 - 33615
  • [25] Deep Convolutional Neural Networks With Ensemble Learning and Generative Adversarial Networks for Alzheimer's Disease Image Data Classification
    Logan, Robert
    Williams, Brian G.
    Ferreira da Silva, Maria
    Indani, Akash
    Schcolnicov, Nicolas
    Ganguly, Anjali
    Miller, Sean J.
    FRONTIERS IN AGING NEUROSCIENCE, 2021, 13
  • [26] Detect and Remove Watermark in Deep Neural Networks via Generative Adversarial Networks
    Sun, Shichang
    Wang, Haoqi
    Xue, Mingfu
    Zhang, Yushu
    Wang, Jian
    Liu, Weiqiang
    INFORMATION SECURITY (ISC 2021), 2021, 13118 : 341 - 357
  • [27] Control for Intelligent Connected Vehicles Platoon Based on Deep Convolutional Generative Adversarial Networks
    Ding, Zirui
    Song, Xianghui
    Xiang, Junping
    Zhang, Taotao
    CICTP 2023: INNOVATION-EMPOWERED TECHNOLOGY FOR SUSTAINABLE, INTELLIGENT, DECARBONIZED, AND CONNECTED TRANSPORTATION, 2023, : 235 - 244
  • [28] Bidirectional Face Aging Synthesis Based on Improved Deep Convolutional Generative Adversarial Networks
    Liu, Xinhua
    Zou, Yao
    Xie, Chengjuan
    Kuang, Hailan
    Ma, Xiaolin
    INFORMATION, 2019, 10 (02)
  • [29] Deep Convolutional Generative Adversarial Networks in Image-Based Android Malware Detection
    Mercaldo, Francesco
    Martinelli, Fabio
    Santone, Antonella
    COMPUTERS, 2024, 13 (06)
  • [30] Generation method of pavement crack images based on deep convolutional generative adversarial networks
    Pei L.
    Sun Z.
    Sun J.
    Li W.
    Zhang H.
    Zhongnan Daxue Xuebao (Ziran Kexue Ban)/Journal of Central South University (Science and Technology), 2021, 52 (11): : 3899 - 3906