A MENTAL ILLNESS DETECTION MODEL FOR COLLEGE STUDENTS BASED ON BODY BEHAVIOR AND FACIAL EXPRESSION FEATURES

被引:0
|
作者
Li, Keke [1 ,2 ]
Yao, Jian [3 ]
Leung, Chun Kai [4 ,5 ]
Chen, Aiguo [3 ]
机构
[1] Wuxi Vocat Coll Sci & Technol, Sch Intelligent Mfg, Wuxi, Peoples R China
[2] Buriram Rajabhat Univ, Fac Educ, Nai Mueang, Thailand
[3] Jiangnan Univ, Sch Artificial Intelligence & Comp Sci, Wuxi, Peoples R China
[4] City Univ Hong Kong, Dept Publ & Int Affairs, Hong Kong, Peoples R China
[5] Harvard Univ, Fairbank Ctr Chinese Studies, Cambridge, MA USA
关键词
Mental illness detection; physical behavior; facial expression; feature fusion; deep learning; DEPRESSION;
D O I
10.1142/S0219519424400438
中图分类号
Q6 [生物物理学];
学科分类号
071011 ;
摘要
Mental illnesses such as depression are typically neurologically related psychological disorders that affect people's mood, thinking and behavior. As the number of students who are concerned about their mental health continues to rise, depression has emerged as a mental health concern that has a significant impact on both students' academic performance and overall lives. To identify depression in students at an earlier stage, the purpose of this study was to provide a potentially unique approach. An approach to the detection of mental illnesses that is based on deep learning networks is proposed in this paper. First, facial expression and physical activity data are utilized for detecting depression. Second, the transformer model is utilized to extract the characteristics of the individual's physical behavior, and the multiregional attention network (MRAN) is utilized to extract the characteristics of the individual's emotions. The information that is obtained from the two modalities is complementary. Finally, at the fusion stage, this work applies the classification prediction of depression and nondepression (normal) at the decision level. This is done to ensure that the respective modal properties that were learned by the two channels are preserved in their entirety. We have demonstrated that our strategy is highly effective by performing experimental validation using a dataset that we developed ourselves. It is possible to identify depression in children at an earlier stage with the help of this effective remedy. It is anticipated that the findings of this study will provide an efficient screening tool for depression to educational institutions and organizations that focus on mental health, hence assisting students in receiving essential assistance and intervention at an earlier stage.
引用
收藏
页数:16
相关论文
共 50 条
  • [41] Predicting students’ attention in the classroom from Kinect facial and body features
    Janez Zaletelj
    Andrej Košir
    EURASIP Journal on Image and Video Processing, 2017
  • [42] Predicting students' attention in the classroom from Kinect facial and body features
    Zaletelj, Janez
    Kosir, Andrej
    EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2017,
  • [43] Human Expression Recognition Based on Facial Features
    Tarannum, Tasnim
    Paul, Anwesha
    Talukder, Kamrul Hasan
    2016 5TH INTERNATIONAL CONFERENCE ON INFORMATICS, ELECTRONICS AND VISION (ICIEV), 2016, : 990 - 994
  • [44] An explanatory model of behavior towards mental illness.
    García-Silberman, S
    SALUD PUBLICA DE MEXICO, 2002, 44 (04): : 289 - 296
  • [45] Facial Expression Recognition Based on Locational Features
    Cam, Baris Can
    Yalcin, Meltem
    Yavuz, Hasan Serhan
    2016 24TH SIGNAL PROCESSING AND COMMUNICATION APPLICATION CONFERENCE (SIU), 2016, : 1449 - 1452
  • [46] Facial Expression Recognition Based on Features Fusion
    Zhou Changjun
    Wei Xiaopeng
    Zhang Qiang
    INFORMATION TECHNOLOGY FOR MANUFACTURING SYSTEMS, PTS 1 AND 2, 2010, : 1253 - 1259
  • [47] Anatomy based Features for Facial Expression Recognition
    Benli, Kristin S.
    Eskil, M. Taner
    2014 22ND SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2014, : 172 - 175
  • [48] RETRACTED: Detection of fatigue driving behavior based on facial expression (Retracted Article)
    Ding, Ling
    Xiong, Xiaobing
    Bao, Zhenyu
    Hu, Luokai
    Chen, Yu
    Li, Bijun
    Cheng, Yong
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2024, 46 (03) : 7143 - 7153
  • [49] Detection of facial features based on the relaxation algorithm
    Lee, KJ
    Sim, DG
    Park, RH
    VISUAL COMMUNICATIONS AND IMAGE PROCESSING 2000, PTS 1-3, 2000, 4067 : 1074 - +
  • [50] Optimization of College Students' Mental Health Education Based on Improved Intelligent Recognition Model
    Liu, Xiaoqian
    Mathematical Problems in Engineering, 2022, 2022