A lightweight method for face expression recognition based on improved MobileNetV3

被引:3
|
作者
Liang, Xunru [1 ,2 ,3 ]
Liang, Jianfeng [1 ,2 ,3 ]
Yin, Tao [1 ,2 ,3 ]
Tang, Xiaoyu [1 ,2 ,3 ]
机构
[1] South China Normal Univ, Sch Phys & Telecommun Engn, Guangzhou, Peoples R China
[2] South China Normal Univ, Sch Elect & Informat Engn, Foshan, Peoples R China
[3] Natl Demonstrat Ctr Expt Phys Educ, Guangzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
computer vision; emotion recognition; image classification; image recognition; FACIAL EXPRESSION; NETWORK;
D O I
10.1049/ipr2.12798
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Facial expression recognition plays a significant role in the application of man-machine interaction. However, existing models typically have shortcomings with numerous parameters, large model sizes, and high computational costs, which are difficult to deploy in resource-constrained devices. This paper proposes a lightweight network based on improved MobileNetV3 to mitigate these disadvantages. Firstly, we adjust the channels in the high-level network to reduce the number of parameters and model size, and then, the coordinate attention mechanism is introduced to the network, which enhances the attention of the network with few parameters and low computing cost. Furthermore, a complementary pooling structure is designed to improve the coordinate attention mechanism, which enables it to assist the network in extracting salient features sufficiently. In addition, the network with the joint loss consisting of the softmax loss and centre loss is trained, which can minimize the intra-class gap and improve the classification performance. Finally, the network is trained and tested on public datasets FERPlus and RAF-DB, with the best accuracy of 87.5% and 86.6%, respectively. The FLOPs, parameters, and the memory storage size are only 0.19GMac, 1.3 M, and 15.9 MB, respectively, which is lighter than most state-of-the-art networks. Code is available at .
引用
收藏
页码:2375 / 2384
页数:10
相关论文
共 50 条
  • [1] An Improved Lightweight Network Based on MobileNetV3 for Palmprint Recognition
    Zhou, Kaijun
    Deng, Kaiwen
    Chen, Peng
    Hu, Yiliang
    PATTERN RECOGNITION AND COMPUTER VISION, PT I, PRCV 2022, 2022, 13534 : 749 - 761
  • [2] Research on facial expression recognition algorithm based on improved MobileNetV3
    Jiang, Bin
    Li, Nanxing
    Cui, Xiaomei
    Zhang, Qiuwen
    Zhang, Huanlong
    Li, Zuhe
    Liu, Weihua
    EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2024, 2024 (01)
  • [3] A new lightweight network based on MobileNetV3
    Zhao, Liquan
    Wang, Leilei
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2022, 16 (01): : 1 - 15
  • [4] An Improved Lightweight Network MobileNetv3 Based YOLOv3 for Pedestrian Detection
    Zhang, Xiaxia
    Li, Ning
    Zhang, Ruixin
    2021 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS AND COMPUTER ENGINEERING (ICCECE), 2021, : 114 - 118
  • [5] An Efficient Lightweight Satellite Image Classification Model with Improved MobileNetV3
    Yang, Xiaoteng
    Liu, Lei
    Song, Xifei
    Feng, Jie
    Pei, Qingqi
    Yuan, Xiaoming
    Li, Jianqiao
    IEEE INFOCOM 2024-IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS, INFOCOM WKSHPS 2024, 2024,
  • [6] Gearbox Fault Diagnosis Method Based on Improved MobileNetV3 and Transfer Learning
    Du, Yanping
    Cheng, Xuemin
    Liu, Yuxin
    Dou, Shuihai
    Tu, Juncheng
    Liu, Yanlin
    Su, Xianyang
    TEHNICKI VJESNIK-TECHNICAL GAZETTE, 2023, 30 (01): : 198 - 206
  • [7] Identification Method of Corn Leaf Disease Based on Improved Mobilenetv3 Model
    Bi, Chunguang
    Xu, Suzhen
    Hu, Nan
    Zhang, Shuo
    Zhu, Zhenyi
    Yu, Helong
    AGRONOMY-BASEL, 2023, 13 (02):
  • [8] Lightweight YOLOv5s Human Ear Recognition Based on MobileNetV3 and Ghostnet
    Lei, Yanmin
    Pan, Dong
    Feng, Zhibin
    Qian, Junru
    APPLIED SCIENCES-BASEL, 2023, 13 (11):
  • [9] Zero-Watermarking of Medical Images Based on Improved Lightweight Neural Network MobileNetV3
    Li, Qiuni
    Zhang, Wen
    Liu, Shangqing
    Yan, Taocui
    Du, Jinglong
    Han, Baoru
    CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2025,
  • [10] Classification and recognition of waste drilling fluid flocculation images based on improved MobileNetV3
    Wang, Chuan
    Tian, Rui
    Zhou, Bo
    Lian, Xiaolong
    Li, Bin
    Dong, Qiyu
    Qian, Zhao
    PETROLEUM SCIENCE AND TECHNOLOGY, 2025,