Deep learning detects subtle facial expressions in a multilevel society primate

被引:0
|
作者
Fang, Gu [1 ]
Peng, Xianlin [2 ,3 ]
Xie, Penglin [4 ]
Ren, Jun [1 ]
Peng, Shenglin [4 ]
Feng, Xiaoyi [5 ]
Tian, Xin [1 ]
Zhou, Mingzhu [1 ]
Li, Zhibo [6 ]
Peng, Jinye [2 ]
Matsuzawa, Tetsuro [1 ,7 ,8 ]
Xia, Zhaoqiang [5 ]
Li, Baoguo [1 ]
机构
[1] Northwest Univ, Coll Life Sci, Shaanxi Key Lab Anim Conservat, Xian, Peoples R China
[2] Northwest Univ, Artificial Intelligence Res Inst, Xian, Peoples R China
[3] Northwest Univ, Art Sch, Xian, Peoples R China
[4] Northwest Univ, Sch Informat Sci & Technol, Xian, Peoples R China
[5] Northwestern Polytech Univ, Sch Elect & Informat, Xian, Peoples R China
[6] Northwest Univ, Network & Data Ctr, Xian, Peoples R China
[7] CALTECH, Div Humanity & Social Sci, Pasadena, CA USA
[8] Chubu Gakuin Univ, Dept Pedag, Gifu, Japan
来源
基金
中国国家自然科学基金;
关键词
communication signal; deep learning; facial expression; primates; social system; MOVEMENT CODING SYSTEM; SOCIAL COMPLEXITY; COMMUNICATIVE COMPLEXITY; EVOLUTION; ORGANIZATION; DRIVE;
D O I
10.1111/1749-4877.12905
中图分类号
Q95 [动物学];
学科分类号
071002 ;
摘要
Facial expressions in nonhuman primates are complex processes involving psychological, emotional, and physiological factors, and may use subtle signals to communicate significant information. However, uncertainty surrounds the functional significance of subtle facial expressions in animals. Using artificial intelligence (AI), this study found that nonhuman primates exhibit subtle facial expressions that are undetectable by human observers. We focused on the golden snub-nosed monkeys (Rhinopithecus roxellana), a primate species with a multilevel society. We collected 3427 front-facing images of monkeys from 275 video clips captured in both wild and laboratory settings. Three deep learning models, EfficientNet, RepMLP, and Tokens-To-Token ViT, were utilized for AI recognition. To compare the accuracy of human performance, two groups were recruited: one with prior animal observation experience and one without any such experience. The results showed human observers to correctly detect facial expressions (32.1% for inexperienced humans and 45.0% for experienced humans on average with a chance level of 33%). In contrast, the AI deep learning models achieved significantly higher accuracy rates. The best-performing model achieved an accuracy of 94.5%. Our results provide evidence that golden snub-nosed monkeys exhibit subtle facial expressions. The results further our understanding of animal facial expressions and also how such modes of communication may contribute to the origin of complex primate social systems. First discovery of unrecognized animal subtle facial expressions. Reveals the complexity of nonhuman primate facial expressions. Novel application of artificial intelligence (AI) for primate facial expression analysis. Superiority of AI over human recognition: accuracy, speed, and robustness. Insights into animal social system evolution through facial expressions. image
引用
收藏
页数:14
相关论文
共 50 条
  • [41] A deep learning model for classifying human facial expressions from infrared thermal images
    Bhattacharyya, Ankan
    Chatterjee, Somnath
    Sen, Shibaprasad
    Sinitca, Aleksandr
    Kaplun, Dmitrii
    Sarkar, Ram
    SCIENTIFIC REPORTS, 2021, 11 (01)
  • [42] Deep Learning-Based Emotion Recognition by Fusion of Facial Expressions and Speech Features
    Vardhan, Jasthi Vivek
    Chakravarti, Yelavarti Kalyan
    Chand, Annam Jitin
    2024 2ND WORLD CONFERENCE ON COMMUNICATION & COMPUTING, WCONF 2024, 2024,
  • [43] Deep Learning-Based Human Emotion Detection Framework Using Facial Expressions
    Hou, Jie
    JOURNAL OF INTERCONNECTION NETWORKS, 2022, 22 (SUPP01)
  • [44] Monitoring Neurological Disorder Patients via Deep Learning Based Facial Expressions Analysis
    Munsif, Muhammad
    Ullah, Mohib
    Ahmad, Bilal
    Sajjad, Muhammad
    Cheikh, Faouzi Alaya
    ARTIFICIAL INTELLIGENCE APPLICATIONS AND INNOVATIONS. AIAI 2022 IFIP WG 12.5 INTERNATIONAL WORKSHOPS, 2022, 652 : 412 - 423
  • [45] Noise-Robust Deep Learning Model for Emotion Classification Using Facial Expressions
    Oh, Seungjun
    Kim, Dong-Keun
    IEEE ACCESS, 2024, 12 : 143074 - 143089
  • [46] A deep learning model for classifying human facial expressions from infrared thermal images
    Ankan Bhattacharyya
    Somnath Chatterjee
    Shibaprasad Sen
    Aleksandr Sinitca
    Dmitrii Kaplun
    Ram Sarkar
    Scientific Reports, 11
  • [47] Hybrid Metaheuristics with Deep Learning Enabled Automated Deception Detection and Classification of Facial Expressions
    Alaskar, Haya
    CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 75 (03): : 5433 - 5449
  • [48] Impaired Recognition of Prosody and Subtle Emotional Facial Expressions in Parkinson's Disease
    Buxton, Sharon L.
    MacDonald, Lorraine
    Tippett, Lynette J.
    BEHAVIORAL NEUROSCIENCE, 2013, 127 (02) : 193 - 203
  • [49] Distinguishing Variants of Primate Facial Expressions Using the Facial Action Coding System for Macaques (MaqFACS)
    Clark, Peter
    Waller, Bridget
    Julle-Daniere, Eglantine
    Micheletta, Jerome
    FOLIA PRIMATOLOGICA, 2020, 91 (03) : 284 - 284
  • [50] Female countertactics to male feticide and infanticide in a multilevel primate society
    Xiang, Zuofu
    Yu, Yang
    Yao, Hui
    Hu, Qinglang
    Yang, Wanji
    Li, Ming
    BEHAVIORAL ECOLOGY, 2022, 33 (04) : 679 - 687