A lightweight method for face expression recognition based on improved MobileNetV3

被引:3
|
作者
Liang, Xunru [1 ,2 ,3 ]
Liang, Jianfeng [1 ,2 ,3 ]
Yin, Tao [1 ,2 ,3 ]
Tang, Xiaoyu [1 ,2 ,3 ]
机构
[1] South China Normal Univ, Sch Phys & Telecommun Engn, Guangzhou, Peoples R China
[2] South China Normal Univ, Sch Elect & Informat Engn, Foshan, Peoples R China
[3] Natl Demonstrat Ctr Expt Phys Educ, Guangzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
computer vision; emotion recognition; image classification; image recognition; FACIAL EXPRESSION; NETWORK;
D O I
10.1049/ipr2.12798
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Facial expression recognition plays a significant role in the application of man-machine interaction. However, existing models typically have shortcomings with numerous parameters, large model sizes, and high computational costs, which are difficult to deploy in resource-constrained devices. This paper proposes a lightweight network based on improved MobileNetV3 to mitigate these disadvantages. Firstly, we adjust the channels in the high-level network to reduce the number of parameters and model size, and then, the coordinate attention mechanism is introduced to the network, which enhances the attention of the network with few parameters and low computing cost. Furthermore, a complementary pooling structure is designed to improve the coordinate attention mechanism, which enables it to assist the network in extracting salient features sufficiently. In addition, the network with the joint loss consisting of the softmax loss and centre loss is trained, which can minimize the intra-class gap and improve the classification performance. Finally, the network is trained and tested on public datasets FERPlus and RAF-DB, with the best accuracy of 87.5% and 86.6%, respectively. The FLOPs, parameters, and the memory storage size are only 0.19GMac, 1.3 M, and 15.9 MB, respectively, which is lighter than most state-of-the-art networks. Code is available at .
引用
收藏
页码:2375 / 2384
页数:10
相关论文
共 50 条
  • [31] Intrusion Detection System for Vehicular Networks Based on MobileNetV3
    Wang, Shaoqiang
    Wang, Yizhe
    Zheng, Baosen
    Cheng, Jiahui
    Su, Yu
    Dai, Yinfei
    IEEE ACCESS, 2024, 12 : 106285 - 106302
  • [32] A study on expression recognition based on improved mobilenetV2 network
    Zhu, Qiming
    Zhuang, Hongwei
    Zhao, Mi
    Xu, Shuangchao
    Meng, Rui
    SCIENTIFIC REPORTS, 2024, 14 (01)
  • [33] A Lightweight Target Detection Algorithm Based on Improved MobileNetv3-YOLOv3
    Fang, Tong
    Du, Baoshuai
    Xue, Yunjia
    Yang, Guang
    Zhao, Jingbo
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, KSEM 2022, PT III, 2022, 13370 : 438 - 448
  • [34] Sheep face recognition and classification based on an improved MobilenetV2 neural network
    Pang, Yue
    Yu, Wenbo
    Zhang, Yongan
    Xuan, Chuanzhong
    Wu, Pei
    INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2023, 20 (01)
  • [35] Apple Surface Defect Detection Method Based on Weight Comparison Transfer Learning with MobileNetV3
    Si, Haiping
    Wang, Yunpeng
    Zhao, Wenrui
    Wang, Ming
    Song, Jiazhen
    Wan, Li
    Song, Zhengdao
    Li, Yujie
    Fernando, Bacao
    Sun, Changxia
    AGRICULTURE-BASEL, 2023, 13 (04):
  • [36] MobileNetV3-CenterNet: A Target Recognition Method for Avoiding Missed Detection Effectively Based on a Lightweight Network
    Li Y.
    Xiong X.
    Xin W.
    Huang J.
    Hao H.
    Journal of Beijing Institute of Technology (English Edition), 2023, 32 (01): : 82 - 94
  • [37] MobileNetV3-CenterNet : A Target Recognition Method for Avoiding Missed Detection Effectively Based on a Lightweight Network
    Yajing Li
    Xiaoyan Xiong
    Wenbin Xin
    Jiahai Huang
    Huimin Hao
    Journal of Beijing Institute of Technology, 2023, 32 (01) : 82 - 94
  • [38] A Resource-Limited FPGA-based MobileNetV3 Accelerator
    Jewajinda, Yutana
    Thongkum, Thanapol
    PROCEEDINGS OF 2022 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2022, : 619 - 622
  • [39] An Improved MobileNetV3 Mushroom Quality Classification Model Using Images with Complex Backgrounds
    Zhu, Fengwu
    Sun, Yan
    Zhang, Yuqing
    Zhang, Weijian
    Qi, Ji
    AGRONOMY-BASEL, 2023, 13 (12):
  • [40] An optimized deep learning based depthwise separable MobileNetV3 approach for automatic finger vein recognition system
    Deshmukh, Sambhaji Vamanrao
    Zulpe, Nitish Shankar
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (24) : 64285 - 64313