Neural network modeling of altered facial expression recognition in autism spectrum disorders based on predictive processing framework

被引:9
|
作者
Takahashi, Yuta [1 ,2 ]
Murata, Shingo [3 ]
Idei, Hayato [4 ]
Tomita, Hiroaki [1 ]
Yamashita, Yuichi [2 ]
机构
[1] Tohoku Univ Hosp, Dept Psychiat, Sendai, Miyagi, Japan
[2] Natl Ctr Neurol & Psychiat, Dept Med Informat, 4-1-1 Ogawa Higashi, Kodaira, Tokyo 1878502, Japan
[3] Keio Univ, Fac Sci & Technol, Dept Elect & Elect Engn, Tokyo, Japan
[4] Waseda Univ, Dept Intermedia Studies, Tokyo, Japan
关键词
COMPUTATIONAL PSYCHIATRY; EMOTION RECOGNITION; BRAIN;
D O I
10.1038/s41598-021-94067-x
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The mechanism underlying the emergence of emotional categories from visual facial expression information during the developmental process is largely unknown. Therefore, this study proposes a system-level explanation for understanding the facial emotion recognition process and its alteration in autism spectrum disorder (ASD) from the perspective of predictive processing theory. Predictive processing for facial emotion recognition was implemented as a hierarchical recurrent neural network (RNN). The RNNs were trained to predict the dynamic changes of facial expression movies for six basic emotions without explicit emotion labels as a developmental learning process, and were evaluated by the performance of recognizing unseen facial expressions for the test phase. In addition, the causal relationship between the network characteristics assumed in ASD and ASD-like cognition was investigated. After the developmental learning process, emotional clusters emerged in the natural course of self-organization in higher-level neurons, even though emotional labels were not explicitly instructed. In addition, the network successfully recognized unseen test facial sequences by adjusting higher-level activity through the process of minimizing precision-weighted prediction error. In contrast, the network simulating altered intrinsic neural excitability demonstrated reduced generalization capability and impaired emotional clustering in higher-level neurons. Consistent with previous findings from human behavioral studies, an excessive precision estimation of noisy details underlies this ASD-like cognition. These results support the idea that impaired facial emotion recognition in ASD can be explained by altered predictive processing, and provide possible insight for investigating the neurophysiological basis of affective contact.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Altered auditory and multisensory temporal processing in autism spectrum disorders
    Kwakye, Leslie D.
    Foss-Feig, Jennifer H.
    Cascio, Carissa J.
    Stone, Wendy L.
    Wallace, Mark T.
    FRONTIERS IN INTEGRATIVE NEUROSCIENCE, 2011, 4
  • [22] Facial expression recognition based on deep convolutional neural network
    Wang, Kejun
    Chen, Jing
    Zhang, Xinyi
    Sun, Liying
    2018 IEEE 8TH ANNUAL INTERNATIONAL CONFERENCE ON CYBER TECHNOLOGY IN AUTOMATION, CONTROL, AND INTELLIGENT SYSTEMS (IEEE-CYBER), 2018, : 629 - 634
  • [23] Efficient facial expression recognition based on convolutional neural network
    Cai, Yongxiang
    Gao, Jingwen
    Zhang, Gen
    Liu, Yuangang
    INTELLIGENT DATA ANALYSIS, 2021, 25 (01) : 139 - 154
  • [24] Facial expression recognition based on VGGNet convolutional neural network
    He Jun
    Li Shuai
    Shen Jinming
    Liu Yue
    Wang Jingwei
    Jin Peng
    2018 CHINESE AUTOMATION CONGRESS (CAC), 2018, : 4146 - 4151
  • [25] APPROACH FOR FACIAL EXPRESSION RECOGNITION BASED ON NEURAL NETWORK ENSEMBLE
    Bai, Xue-Fei
    Wang, Wen-Jian
    PROCEEDINGS OF 2009 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-6, 2009, : 19 - 23
  • [26] Facial Expression Recognition Based on Improved Convolutional Neural Network
    Siyuan L.
    Libiao W.
    Yuzhen Z.
    Journal of Engineering Science and Technology Review, 2023, 16 (01) : 61 - 67
  • [27] A neural network facial expression recognition system using unsupervised local processing
    Franco, L
    Treves, A
    ISPA 2001: PROCEEDINGS OF THE 2ND INTERNATIONAL SYMPOSIUM ON IMAGE AND SIGNAL PROCESSING AND ANALYSIS, 2001, : 628 - 632
  • [28] Gabor Neural Network Based Facial Expression Recognition for Assistive Speech Expression
    Theng, Lau Bee
    ADVANCES IN NEURO-INFORMATION PROCESSING, PT II, 2009, 5507 : 591 - 598
  • [29] Remediation of Deficits in Recognition of Facial Emotions in Children with Autism Spectrum Disorders
    Weinger, Paige M.
    Depue, Richard A.
    CHILD & FAMILY BEHAVIOR THERAPY, 2011, 33 (01) : 20 - 31
  • [30] Atypical recognition of dynamic changes in facial expressions in autism spectrum disorders
    Sato, Wataru
    Uono, Shota
    Toichi, Motomi
    RESEARCH IN AUTISM SPECTRUM DISORDERS, 2013, 7 (07) : 906 - 912