Deep learning detects subtle facial expressions in a multilevel society primate

被引:0
|
作者
Fang, Gu [1 ]
Peng, Xianlin [2 ,3 ]
Xie, Penglin [4 ]
Ren, Jun [1 ]
Peng, Shenglin [4 ]
Feng, Xiaoyi [5 ]
Tian, Xin [1 ]
Zhou, Mingzhu [1 ]
Li, Zhibo [6 ]
Peng, Jinye [2 ]
Matsuzawa, Tetsuro [1 ,7 ,8 ]
Xia, Zhaoqiang [5 ]
Li, Baoguo [1 ]
机构
[1] Northwest Univ, Coll Life Sci, Shaanxi Key Lab Anim Conservat, Xian, Peoples R China
[2] Northwest Univ, Artificial Intelligence Res Inst, Xian, Peoples R China
[3] Northwest Univ, Art Sch, Xian, Peoples R China
[4] Northwest Univ, Sch Informat Sci & Technol, Xian, Peoples R China
[5] Northwestern Polytech Univ, Sch Elect & Informat, Xian, Peoples R China
[6] Northwest Univ, Network & Data Ctr, Xian, Peoples R China
[7] CALTECH, Div Humanity & Social Sci, Pasadena, CA USA
[8] Chubu Gakuin Univ, Dept Pedag, Gifu, Japan
来源
基金
中国国家自然科学基金;
关键词
communication signal; deep learning; facial expression; primates; social system; MOVEMENT CODING SYSTEM; SOCIAL COMPLEXITY; COMMUNICATIVE COMPLEXITY; EVOLUTION; ORGANIZATION; DRIVE;
D O I
10.1111/1749-4877.12905
中图分类号
Q95 [动物学];
学科分类号
071002 ;
摘要
Facial expressions in nonhuman primates are complex processes involving psychological, emotional, and physiological factors, and may use subtle signals to communicate significant information. However, uncertainty surrounds the functional significance of subtle facial expressions in animals. Using artificial intelligence (AI), this study found that nonhuman primates exhibit subtle facial expressions that are undetectable by human observers. We focused on the golden snub-nosed monkeys (Rhinopithecus roxellana), a primate species with a multilevel society. We collected 3427 front-facing images of monkeys from 275 video clips captured in both wild and laboratory settings. Three deep learning models, EfficientNet, RepMLP, and Tokens-To-Token ViT, were utilized for AI recognition. To compare the accuracy of human performance, two groups were recruited: one with prior animal observation experience and one without any such experience. The results showed human observers to correctly detect facial expressions (32.1% for inexperienced humans and 45.0% for experienced humans on average with a chance level of 33%). In contrast, the AI deep learning models achieved significantly higher accuracy rates. The best-performing model achieved an accuracy of 94.5%. Our results provide evidence that golden snub-nosed monkeys exhibit subtle facial expressions. The results further our understanding of animal facial expressions and also how such modes of communication may contribute to the origin of complex primate social systems. First discovery of unrecognized animal subtle facial expressions. Reveals the complexity of nonhuman primate facial expressions. Novel application of artificial intelligence (AI) for primate facial expression analysis. Superiority of AI over human recognition: accuracy, speed, and robustness. Insights into animal social system evolution through facial expressions. image
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Deep learning reveals what facial expressions mean to people in different cultures
    Brooks, Jeffrey A.
    Kim, Lauren
    Opara, Michael
    Keltner, Dacher
    Fang, Xia
    Monroy, Maria
    Corona, Rebecca
    Tzirakis, Panagiotis
    Baird, Alice
    Metrick, Jacob
    Taddesse, Nolawi
    Zegeye, Kiflom
    Cowen, Alan S.
    ISCIENCE, 2024, 27 (03)
  • [22] Pain detection through facial expressions in children with autism using deep learning
    Sandeep, P. V. K.
    Kumar, N. Suresh
    SOFT COMPUTING, 2024, 28 (5) : 4621 - 4630
  • [23] A system using an interactive interface for synthesizing facial images with subtle expressions
    Isono, Katsunori
    Yamamoto, Mitsuo
    Oda, Masaomi
    Akamatsu, Shigeru
    Kyokai Joho Imeji Zasshi/Journal of the Institute of Image Information and Television Engineers, 2000, 54 (06): : 858 - 864
  • [24] A Robust-Facial Expressions Recognition System using Deep Learning Architectures
    Ilyas, Bendjillali Ridha
    Abderrazak, Tadjeddine Ali
    Sofiane, Bendelhoum Mohamed
    Bahidja, Boukenadil
    Imane, Houam
    Miloud, Kamline
    2023 International Conference on Decision Aid Sciences and Applications, DASA 2023, 2023, : 541 - 546
  • [25] IMPROVED CATEGORIZATION OF SUBTLE FACIAL EXPRESSIONS MODULATES LATE POSITIVE POTENTIAL
    Pollux, P. M. J.
    NEUROSCIENCE, 2016, 322 : 152 - 163
  • [26] Understanding Naturalistic Facial Expressions with Deep Learning and Multimodal Large Language Models
    Bian, Yifan
    Kuester, Dennis
    Liu, Hui
    Krumhuber, Eva G.
    SENSORS, 2024, 24 (01)
  • [27] Hybrid-Deep Learning Model for Emotion Recognition Using Facial Expressions
    Verma, Garima
    Verma, Hemraj
    REVIEW OF SOCIONETWORK STRATEGIES, 2020, 14 (02): : 171 - 180
  • [28] Application of Multiple Deep Learning Architectures for Emotion Classification Based on Facial Expressions
    Qian, Cheng
    Marques, Joao Alexandre Lobo
    de Alexandria, Auzuir Ripardo
    Fong, Simon James
    SENSORS, 2025, 25 (05)
  • [29] Pain detection through facial expressions in children with autism using deep learning
    P. V. K. Sandeep
    N. Suresh Kumar
    Soft Computing, 2024, 28 : 4621 - 4630
  • [30] Analysis of Various Facial Expressions of Horses as a Welfare Indicator Using Deep Learning
    Kim, Su Min
    Cho, Gil Jae
    VETERINARY SCIENCES, 2023, 10 (04)