Enhanced Facial Emotion Recognition Using Vision Transformer Models

被引:0
|
作者
Fatima, N. Sabiyath [1 ]
Deepika, G. [2 ]
Anthonisamy, Arun [3 ]
Chitra, R. Jothi [4 ]
Muralidharan, J. [5 ]
Alagarsamy, Manjunathan [6 ]
Ramyasree, Kummari [7 ]
机构
[1] BS Abdur Rahman Crescent Inst Sci & Technol, Dept Comp Sci & Engn, Chennai 600048, Tamil Nadu, India
[2] MallaReddy Engn Coll Women, Dept Elect & Commun Engn, Secunderabad 500100, Telangana, India
[3] Panimalar Engn Coll, Dept Comp Sci & Business Syst, Chennai 600123, Tamil Nadu, India
[4] Velammal Inst Technol, Dept Elect & Commun Engn, Tiruvallur 601204, Tamil Nadu, India
[5] KPR Inst Engn & Technol, Dept Elect & Commun Engn, Coimbatore 641407, Tamil Nadu, India
[6] K Ramakrishnan Coll Technol, Dept Elect & Commun Engn, Trichy 621112, Tamil Nadu, India
[7] TR Univ Technol, Dept ECE, Patna, Bihar, India
关键词
Facial emotion recognition; Vision transformer; Self-attention; Machine learning; Artificial intelligence; Computer vision; Deep learning; Emotion detection;
D O I
10.1007/s42835-024-02118-w
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Automation of facial emotion recognition is an important branch of artificial intelligence and computer vision that has many potential applications in mental health diagnostics, human-computer interaction and security. The existing methods, however, usually have weaknesses in robustness, scalability and computational efficiency. This work proposes a self-attention-based Vision Transformer method that treats images as sequences of patches to capture global dependencies and spatial relations more effectively than other methods. The model is trained and evaluated using a large-scale dataset. On average, the model achieves an overall accuracy of 97%, with good precision, recall and F1 scores in most emotion categories. The model performed better and was more robust to variations in illumination and facial pose compared to other existing methods. This work takes a step forward in facial emotion recognition technology, providing a large-scale and efficient solution for real-world applications. Facial Emotion Recognition, a New Vision Transformer Based on Self-Attention for Machine Learning.
引用
收藏
页码:1143 / 1152
页数:10
相关论文
共 50 条
  • [1] An enhanced speech emotion recognition using vision transformer
    Akinpelu, Samson
    Viriri, Serestina
    Adegun, Adekanmi
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [2] Comparative Analysis of Vision Transformer Models for Facial Emotion Recognition Using Augmented Balanced Datasets
    Bobojanov, Sukhrob
    Kim, Byeong Man
    Arabboev, Mukhriddin
    Begmatov, Shohruh
    APPLIED SCIENCES-BASEL, 2023, 13 (22):
  • [3] Facial Emotion Recognition Using Computer Vision
    Jonathan
    Lim, Andreas Pangestu
    Paoline
    Kusuma, Gede Putra
    Zahra, Amalia
    2018 INDONESIAN ASSOCIATION FOR PATTERN RECOGNITION INTERNATIONAL CONFERENCE (INAPR), 2018, : 46 - 50
  • [4] A study on computer vision for facial emotion recognition
    Huang, Zi-Yu
    Chiang, Chia-Chin
    Chen, Jian-Hao
    Chen, Yi-Chian
    Chung, Hsin-Lung
    Cai, Yu-Ping
    Hsu, Hsiu-Chuan
    SCIENTIFIC REPORTS, 2023, 13 (01)
  • [5] A study on computer vision for facial emotion recognition
    Zi-Yu Huang
    Chia-Chin Chiang
    Jian-Hao Chen
    Yi-Chian Chen
    Hsin-Lung Chung
    Yu-Ping Cai
    Hsiu-Chuan Hsu
    Scientific Reports, 13
  • [6] ViTFER: Facial Emotion Recognition with Vision Transformers
    Chaudhari, Aayushi
    Bhatt, Chintan
    Krishna, Achyut
    Mazzeo, Pier Luigi
    APPLIED SYSTEM INNOVATION, 2022, 5 (04)
  • [7] Applying a Convolutional Vision Transformer for Emotion Recognition in Children with Autism: Fusion of Facial Expressions and Speech Features
    Wang, Yonggu
    Pan, Kailin
    Shao, Yifan
    Ma, Jiarong
    Li, Xiaojuan
    APPLIED SCIENCES-BASEL, 2025, 15 (06):
  • [8] Recognition of facial emotion in low vision: A flexible usage of facial features
    Boucart, Muriel
    Dinon, Jean-Francois
    Despretz, Pascal
    Desmettre, Thomas
    Hladiuk, Katrine
    Oliva, Aude
    VISUAL NEUROSCIENCE, 2008, 25 (04) : 603 - 609
  • [9] Facial Expression Recognition Based on Squeeze Vision Transformer
    Kim, Sangwon
    Nam, Jaeyeal
    Ko, Byoung Chul
    SENSORS, 2022, 22 (10)
  • [10] Fine Tuning Vision Transformer Model for Facial Emotion Recognition: Performance Analysis for Human-Machine Teaming
    Roka, Sanjeev
    Rawat, Danda B.
    2023 IEEE 24TH INTERNATIONAL CONFERENCE ON INFORMATION REUSE AND INTEGRATION FOR DATA SCIENCE, IRI, 2023, : 134 - 139