Neural network modeling of altered facial expression recognition in autism spectrum disorders based on predictive processing framework

被引:9
|
作者
Takahashi, Yuta [1 ,2 ]
Murata, Shingo [3 ]
Idei, Hayato [4 ]
Tomita, Hiroaki [1 ]
Yamashita, Yuichi [2 ]
机构
[1] Tohoku Univ Hosp, Dept Psychiat, Sendai, Miyagi, Japan
[2] Natl Ctr Neurol & Psychiat, Dept Med Informat, 4-1-1 Ogawa Higashi, Kodaira, Tokyo 1878502, Japan
[3] Keio Univ, Fac Sci & Technol, Dept Elect & Elect Engn, Tokyo, Japan
[4] Waseda Univ, Dept Intermedia Studies, Tokyo, Japan
关键词
COMPUTATIONAL PSYCHIATRY; EMOTION RECOGNITION; BRAIN;
D O I
10.1038/s41598-021-94067-x
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The mechanism underlying the emergence of emotional categories from visual facial expression information during the developmental process is largely unknown. Therefore, this study proposes a system-level explanation for understanding the facial emotion recognition process and its alteration in autism spectrum disorder (ASD) from the perspective of predictive processing theory. Predictive processing for facial emotion recognition was implemented as a hierarchical recurrent neural network (RNN). The RNNs were trained to predict the dynamic changes of facial expression movies for six basic emotions without explicit emotion labels as a developmental learning process, and were evaluated by the performance of recognizing unseen facial expressions for the test phase. In addition, the causal relationship between the network characteristics assumed in ASD and ASD-like cognition was investigated. After the developmental learning process, emotional clusters emerged in the natural course of self-organization in higher-level neurons, even though emotional labels were not explicitly instructed. In addition, the network successfully recognized unseen test facial sequences by adjusting higher-level activity through the process of minimizing precision-weighted prediction error. In contrast, the network simulating altered intrinsic neural excitability demonstrated reduced generalization capability and impaired emotional clustering in higher-level neurons. Consistent with previous findings from human behavioral studies, an excessive precision estimation of noisy details underlies this ASD-like cognition. These results support the idea that impaired facial emotion recognition in ASD can be explained by altered predictive processing, and provide possible insight for investigating the neurophysiological basis of affective contact.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Advertisement System Based on Facial Expression Recognition and Convolutional Neural Network
    Truong Quang Vinh
    Phan Tran Dac Thinh
    ISCIT 2019: PROCEEDINGS OF 2019 19TH INTERNATIONAL SYMPOSIUM ON COMMUNICATIONS AND INFORMATION TECHNOLOGIES (ISCIT), 2019, : 476 - 480
  • [32] Facial expression recognition based on wavelet transform and MLP neural network
    Lu, YZ
    Wei, ZY
    2004 7TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS, VOLS 1-3, 2004, : 1340 - 1343
  • [33] Gabor wavelet neural network-based facial expression recognition
    Lee, SW
    Kim, DJ
    Park, KH
    Bien, Z
    8TH WORLD MULTI-CONFERENCE ON SYSTEMICS, CYBERNETICS AND INFORMATICS, VOL V, PROCEEDINGS: COMPUTER SCIENCE AND ENGINEERING, 2004, : 383 - 387
  • [34] Facial Expression Recognition Based on Random Forest and Convolutional Neural Network
    Wang, Yingying
    Li, Yibin
    Song, Yong
    Rong, Xuewen
    INFORMATION, 2019, 10 (12)
  • [35] Emotion Recognition System by a Neural Network Based Facial Expression Analysis
    Filko, Damir
    Martinovic, Goran
    AUTOMATIKA, 2013, 54 (02) : 263 - 272
  • [36] A Hybrid Facial Expression Recognition System Based on Recurrent Neural Network
    Guo, Jing-Ming
    Huang, Po-Cheng
    Chang, Li-Ying
    2019 16TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE (AVSS), 2019,
  • [37] Multi pose facial expression recognition based on convolutional neural network
    Feng, Yongliang
    INTERNATIONAL JOURNAL OF BIOMETRICS, 2022, 14 (3-4) : 253 - 267
  • [38] Facial Expression Recognition Method Based on Cascade Convolution Neural Network
    Liu, Weida
    Fang, Jian
    IWCMC 2021: 2021 17TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE (IWCMC), 2021, : 1012 - 1015
  • [39] Facial Expression Recognition Based on Multi-dataset Neural Network
    Yang, Bin
    Li, Zhenyu
    Cao, Enguo
    RADIOENGINEERING, 2020, 29 (01) : 259 - 266
  • [40] Automatic Facial Feature Extraction and Expression Recognition based on Neural Network
    Khandait, S. P.
    Thool, R. C.
    Khandait, P. D.
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2011, 2 (01) : 113 - 118