Neural network modeling of altered facial expression recognition in autism spectrum disorders based on predictive processing framework

被引:9
|
作者
Takahashi, Yuta [1 ,2 ]
Murata, Shingo [3 ]
Idei, Hayato [4 ]
Tomita, Hiroaki [1 ]
Yamashita, Yuichi [2 ]
机构
[1] Tohoku Univ Hosp, Dept Psychiat, Sendai, Miyagi, Japan
[2] Natl Ctr Neurol & Psychiat, Dept Med Informat, 4-1-1 Ogawa Higashi, Kodaira, Tokyo 1878502, Japan
[3] Keio Univ, Fac Sci & Technol, Dept Elect & Elect Engn, Tokyo, Japan
[4] Waseda Univ, Dept Intermedia Studies, Tokyo, Japan
关键词
COMPUTATIONAL PSYCHIATRY; EMOTION RECOGNITION; BRAIN;
D O I
10.1038/s41598-021-94067-x
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The mechanism underlying the emergence of emotional categories from visual facial expression information during the developmental process is largely unknown. Therefore, this study proposes a system-level explanation for understanding the facial emotion recognition process and its alteration in autism spectrum disorder (ASD) from the perspective of predictive processing theory. Predictive processing for facial emotion recognition was implemented as a hierarchical recurrent neural network (RNN). The RNNs were trained to predict the dynamic changes of facial expression movies for six basic emotions without explicit emotion labels as a developmental learning process, and were evaluated by the performance of recognizing unseen facial expressions for the test phase. In addition, the causal relationship between the network characteristics assumed in ASD and ASD-like cognition was investigated. After the developmental learning process, emotional clusters emerged in the natural course of self-organization in higher-level neurons, even though emotional labels were not explicitly instructed. In addition, the network successfully recognized unseen test facial sequences by adjusting higher-level activity through the process of minimizing precision-weighted prediction error. In contrast, the network simulating altered intrinsic neural excitability demonstrated reduced generalization capability and impaired emotional clustering in higher-level neurons. Consistent with previous findings from human behavioral studies, an excessive precision estimation of noisy details underlies this ASD-like cognition. These results support the idea that impaired facial emotion recognition in ASD can be explained by altered predictive processing, and provide possible insight for investigating the neurophysiological basis of affective contact.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Publisher Correction: Neural network modeling of altered facial expression recognition in autism spectrum disorders based on predictive processing framework
    Yuta Takahashi
    Shingo Murata
    Hayato Idei
    Hiroaki Tomita
    Yuichi Yamashita
    Scientific Reports, 11
  • [2] An investigation of basic facial expression recognition in autism spectrum disorders
    Wallace, Simon
    Coleman, Michael
    Bailey, Anthony
    COGNITION & EMOTION, 2008, 22 (07) : 1353 - 1380
  • [3] Facial Expression Production and Recognition in Autism Spectrum Disorders: A Shifting Landscape
    Keating, Connor Tom
    Cook, Jennifer Louise
    CHILD AND ADOLESCENT PSYCHIATRIC CLINICS OF NORTH AMERICA, 2020, 29 (03) : 557 - 571
  • [4] Facial Expression Production and Recognition in Autism Spectrum Disorders A Shifting Landscape
    Keating, Connor Tom
    Cook, Jennifer Louise
    PSYCHIATRIC CLINICS OF NORTH AMERICA, 2021, 44 (01) : 125 - 139
  • [5] On the Trail of Facial Processing in Autism Spectrum Disorders
    Arellano, Diana
    Schaller, Ulrich Max
    Rauh, Reinhold
    Helzle, Volker
    Spicker, Marc
    Deussen, Oliver
    INTELLIGENT VIRTUAL AGENTS, IVA 2015, 2015, 9238 : 432 - 441
  • [6] Facial expression recognition for monitoring neurological disorders based on convolutional neural network
    Gozde Yolcu
    Ismail Oztel
    Serap Kazan
    Cemil Oz
    Kannappan Palaniappan
    Teresa E. Lever
    Filiz Bunyak
    Multimedia Tools and Applications, 2019, 78 : 31581 - 31603
  • [7] Facial expression recognition for monitoring neurological disorders based on convolutional neural network
    Yolcu, Gozde
    Oztel, Ismail
    Kazan, Serap
    Oz, Cemil
    Palaniappan, Kannappan
    Lever, Teresa E.
    Bunyak, Filiz
    MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (22) : 31581 - 31603
  • [8] The structural neural correlates of atypical facial expression recognition in autism spectrum disorder
    Shota Uono
    Wataru Sato
    Takanori Kochiyama
    Sayaka Yoshimura
    Reiko Sawada
    Yasutaka Kubota
    Morimitsu Sakihama
    Motomi Toichi
    Brain Imaging and Behavior, 2022, 16 : 1428 - 1440
  • [9] The structural neural correlates of atypical facial expression recognition in autism spectrum disorder
    Uono, Shota
    Sato, Wataru
    Kochiyama, Takanori
    Yoshimura, Sayaka
    Sawada, Reiko
    Kubota, Yasutaka
    Sakihama, Morimitsu
    Toichi, Motomi
    BRAIN IMAGING AND BEHAVIOR, 2022, 16 (03) : 1428 - 1440
  • [10] Facial Expression Recognition Based on Convolution Neural Network
    Duan, Yue
    Zhou, Linli
    Wu, Yue
    PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING, INFORMATION SCIENCE & APPLICATION TECHNOLOGY (ICCIA 2017), 2017, 74 : 339 - 343