Cognitive Wearable Robotics for Autism Perception Enhancement

被引:18
作者
Chen, Min [1 ]
Xiao, Wenjing [1 ]
Hu, Long [1 ]
Ma, Yujun [1 ]
Zhang, Yin [2 ]
Tao, Guangming [3 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Comp Sci & Technol, Wuhan, Hubei, Peoples R China
[2] Univ Elect Sci & Technol China, Sch Informat & Commun Engn, Chengdu, Sichuan, Peoples R China
[3] Huazhong Univ Sci & Technol, Wuhan Natl Lab Optoelect, Wuhan, Hubei, Peoples R China
基金
国家重点研发计划;
关键词
Autism therapy; multi-modal and multi-scene; emotion perception; reinforcement learning; CHILDREN;
D O I
10.1145/3450630
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Autism spectrum disorder (ASD) is a serious hazard to the physical and mental health of children, which limits the social activities of patients throughout their lives and places a heavy burden on families and society. The developments of communication techniques and artificial intelligence (AI) have provided new potential methods for the treatment of autism. The existing treatment systems based on AI for children with ASD focus on detecting health status and developing social skills. However, the contradiction between the terminal interaction capability and availability cannot meet the needs for real application scenarios. At the same time, the lack of diverse data cannot provide individualized care for autistic children. To explore this robot-based approach, a novel AI-based first-view-robot architecture is proposed in this article. By providing care from the first-person perspective, the proposed wearable robot overcomes the difficulty of the absence of cognitive ability in the third-view of traditional robotics and improves the social interaction ability of children with ASD. The first-view-robot architecture meets the requirements of dynamic, individualized, and highly immersed interaction services for autistic children. First, the multi-modal and multi-scene data collection processes of standard, static, and dynamic datasets are introduced in detail. Then, to comprehensively evaluate the learning ability of children with ASD through mental states and external performances, a learning assessment model with emotion correction is proposed. Besides, a wearable robot-assisted environment perception and expression enhancement mechanism for children with ASD is realized by reinforcement learning, which can be adapted to interactive environments with optimal action policies. An interactive testbed for children with ASD treatments is demonstrated and experimental cases for test subjects are presented. Last, three open issues are discussed from data processing, robot designing, and service responding perspectives.
引用
收藏
页数:16
相关论文
共 26 条
[1]   A Machine Learning Based WSN System for Autism Activity Recognition [J].
Alwakeel, Sami S. ;
Alhalabi, Bassem ;
Aggoune, Hadi ;
Alwakeel, Mohammad .
2015 IEEE 14TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA), 2015, :771-776
[2]   OpenFace 2.0: Facial Behavior Analysis Toolkit [J].
Baltrusaitis, Tadas ;
Zadeh, Amir ;
Lim, Yao Chong ;
Morency, Louis-Philippe .
PROCEEDINGS 2018 13TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE & GESTURE RECOGNITION (FG 2018), 2018, :59-66
[3]   Living with I-Fabric: Smart Living Powered by Intelligent Fabric and Deep Analytics [J].
Chen, Min ;
Jiang, Yingying ;
Guizani, Nadra ;
Zhou, Jun ;
Tao, Guangming ;
Yin, Jun ;
Hwang, Kai .
IEEE NETWORK, 2020, 34 (05) :156-163
[4]   Label-less Learning for Emotion Cognition [J].
Chen, Min ;
Hao, Yixue .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (07) :2430-2440
[5]   Wearable Affective Robot [J].
Chen, Min ;
Zhou, Jun ;
Tao, Guangming ;
Yang, Jun ;
Hu, Long .
IEEE ACCESS, 2018, 6 :64766-64776
[6]   Autism spectrum disorder at the crossroad between genes and environment: contributions, convergences, and interactions in ASD developmental pathophysiology [J].
Cheroni, Cristina ;
Caporale, Nicolo ;
Testa, Giuseppe .
MOLECULAR AUTISM, 2020, 11 (01)
[7]   The autism brain imaging data exchange: towards a large-scale evaluation of the intrinsic brain architecture in autism [J].
Di Martino, A. ;
Yan, C-G ;
Li, Q. ;
Denio, E. ;
Castellanos, F. X. ;
Alaerts, K. ;
Anderson, J. S. ;
Assaf, M. ;
Bookheimer, S. Y. ;
Dapretto, M. ;
Deen, B. ;
Delmonte, S. ;
Dinstein, I. ;
Ertl-Wagner, B. ;
Fair, D. A. ;
Gallagher, L. ;
Kennedy, D. P. ;
Keown, C. L. ;
Keysers, C. ;
Lainhart, J. E. ;
Lord, C. ;
Luna, B. ;
Menon, V. ;
Minshew, N. J. ;
Monk, C. S. ;
Mueller, S. ;
Mueller, R. A. ;
Nebel, M. B. ;
Nigg, J. T. ;
O'Hearn, K. ;
Pelphrey, K. A. ;
Peltier, S. J. ;
Rudie, J. D. ;
Sunaert, S. ;
Thioux, M. ;
Tyszka, J. M. ;
Uddin, L. Q. ;
Verhoeven, J. S. ;
Wenderoth, N. ;
Wiggins, J. L. ;
Mostofsky, S. H. ;
Milham, M. P. .
MOLECULAR PSYCHIATRY, 2014, 19 (06) :659-667
[8]   Estimating Autism Severity in Young Children From Speech Signals Using a Deep Neural Network [J].
Eni, Marina ;
Dinstein, Ilan ;
Ilan, Michal ;
Menashe, Idan ;
Meiri, Gal ;
Zigel, Yaniv .
IEEE ACCESS, 2020, 8 :139489-139500
[9]  
Esteban P.G., 2017, Paladyn, Journal of Behavioral Robotics, V8, P18, DOI DOI 10.1515/pjbr-2017-0002
[10]   Missed diagnoses and misdiagnoses of adults with autism spectrum disorder [J].
Fusar-Poli, Laura ;
Brondino, Natascia ;
Politi, Pierluigi ;
Aguglia, Eugenio .
EUROPEAN ARCHIVES OF PSYCHIATRY AND CLINICAL NEUROSCIENCE, 2022, 272 (02) :187-198