Multi-task Facial Landmark Detection Network for Early ASD Screening

被引:0
|
作者
Lin, Ruihan [1 ]
Zhang, Hanlin [1 ]
Wang, Xinming [1 ]
Ren, Weihong [1 ]
Wu, Wenhao [1 ]
Liu, Zuode [1 ]
Xu, Xiu [2 ]
Xu, Qiong [2 ]
Liu, Honghai [1 ]
机构
[1] Harbin Inst Technol, Sch Mech Engn & Automat, Shenzhen, Peoples R China
[2] Fudan Univ, Childrens Hosp, Dept Child Hlth Care, Shanghai, Peoples R China
关键词
Autism; Joint attention; Multi-task facial landmark detection; AUTISM; CHILDREN;
D O I
10.1007/978-3-031-13844-7_37
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Joint attention is an important skill that involves coordinating the attention of at least two individuals towards an object or event in early child development, which is usually absent in children with autism. Children's joint attention is an essential part of the diagnosis of autistic children. To improve the effectiveness of autism screening, in this paper, we propose a multi-task facial landmark detection network to enhance the stability of gaze estimation and the accuracy of the joint attention screening result. In order to verify the proposed method, we recruit 39 toddlers aged from 16 to 32 months in this study and build a children-based facial landmarks dataset from 19 subjects. Experiments show that the accuracy of the joint attention screening result is 92.5%, which demonstrates the effectiveness of our method.
引用
收藏
页码:381 / 391
页数:11
相关论文
共 50 条
  • [1] Facial Landmark Detection by Deep Multi-task Learning
    Zhang, Zhanpeng
    Luo, Ping
    Loy, Chen Change
    Tang, Xiaoou
    COMPUTER VISION - ECCV 2014, PT VI, 2014, 8694 : 94 - 108
  • [2] Thermal Facial Landmark Detection by Deep Multi-Task Learning
    Chu, Wei-Ta
    Liu, Yu-Hui
    2019 IEEE 21ST INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP 2019), 2019,
  • [3] Event-Based Multi-Task Facial Landmark and Blink Detection
    Kielty, Paul
    Ryan, Cian
    Shariff, Waseem
    Lemley, Joe
    Corcoran, Peter
    IEEE ACCESS, 2025, 13 : 45609 - 45622
  • [4] Efficient Multi-task based Facial Landmark and Gesture Detection in Monocular Images
    Goenetxea, Jon
    Unzueta, Luis
    Elordi, Unai
    Otaegui, Oihana
    Dornaika, Fadi
    VISAPP: PROCEEDINGS OF THE 16TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS - VOL. 5: VISAPP, 2021, : 680 - 687
  • [5] MULTI-TASK LEARNING NETWORK FOR LANDMARK DETECTION IN ANATOMICAL TREE STRUCTURES
    Tan, Zimeng
    Feng, Jianjiang
    Zhou, Jie
    2021 IEEE 18TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2021, : 1975 - 1979
  • [6] Heterogeneous Multi-task Learning on Non-overlapping Datasets for Facial Landmark Detection
    Semitsu, Takayuki
    Zhao, Xiongxin
    Matsumoto, Wataru
    NEURAL INFORMATION PROCESSING, ICONIP 2016, PT III, 2016, 9949 : 616 - 625
  • [7] Facial Landmark Detection via Self-adaption Model and Multi-task Feature Learning
    Xie, Zhengnan
    Jin, Yi
    Bian, Peng
    Zhou, Wei
    PROCEEDINGS OF 2016 IEEE 13TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP 2016), 2016, : 113 - 117
  • [8] Residual multi-task learning for facial landmark localization and expression recognition
    Chen, Boyu
    Guan, Wenlong
    Li, Peixia
    Ikeda, Naoki
    Hirasawa, Kosuke
    Lu, Huchuan
    PATTERN RECOGNITION, 2021, 115
  • [9] Simultaneous Estimation of Facial Landmark and Attributes with Separation Multi-task Networks
    Matsui, Ryo
    Yamashita, Takayoshi
    Fujiyoshi, Hironobu
    PROCEEDINGS OF THE 14TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 5, 2019, : 265 - 272
  • [10] 3D facial landmark detection based on differential cylindrical projection and multi-task learning
    Terada, Takuma
    Kimura, Ryusuke
    Chen, Yen-Wei
    COMMUNICATIONS IN INFORMATION AND SYSTEMS, 2020, 20 (04) : 443 - 459