3-D Facial Landmarks Detection for Intelligent Video Systems

被引:14
|
作者
Hoang, Van-Thanh [1 ]
Huang, De-Shuang [2 ]
Jo, Kang-Hyun [3 ,4 ]
机构
[1] Univ Ulsan, Grad Sch Elect Engn, Elect & Comp Engn, Ulsan 44610, South Korea
[2] Tongji Univ, Sch Elect & Informat Engn, Inst Machine Learning & Syst Biol, Shanghai 201804, Peoples R China
[3] Tongji Univ, Shanghai, Peoples R China
[4] Univ Ulsan, Sch Elect Engn, Ulsan, South Korea
关键词
Face; Three-dimensional displays; Detectors; Computer architecture; Convolution; Task analysis; Computational modeling; Convolution block; convolutional neural network (CNN); facial landmarks; stacked hourglass;
D O I
10.1109/TII.2020.2966513
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Facial landmark detection is a fundamental research topic in computer vision that is widely adopted in many applications. Recently, thanks to the development of convolutional neural networks, this topic has been largely improved. This article proposes facial-landmark detector, which is based on a state-of-the-art architecture for landmark localization called stacked hourglass network, to obtain accurate facial landmark-points. More specifically, this article uses residual networks as the backbone instead of a 7 x 7 convolution layer. Additionally, it modifies the hourglass modules by using the residual-dense blocks in the mainstream for capturing more efficient features and the 1 x 1 convolution layers in the branch streams for reducing the model size and computational time, instead of the original residual blocks. The proposed architecture also enhances the features from modified hourglass modules with finer-resolution features via a lateral connection to generate more accurate results. The proposed network can outperform other state-of-the-art methods on the AFLW2000-3D dataset and the LS3D-W dataset, the largest three-dimensional (3-D face) alignment dataset to date.
引用
收藏
页码:578 / 586
页数:9
相关论文
共 50 条
  • [1] Novel 3-D video for quantification of facial movement
    Mehta, Ritvik P.
    Zhang, Song
    Hadlock, Tessa A.
    OTOLARYNGOLOGY-HEAD AND NECK SURGERY, 2008, 138 (04) : 468 - 472
  • [2] Microwave Reconstruction of 3-D Human Facial Landmarks Using a Programmable Metasurface
    Li, Mingyi
    Xu, Jiawen
    Cui, Tie Jun
    Li, Lianlin
    IEEE ANTENNAS AND WIRELESS PROPAGATION LETTERS, 2024, 23 (11): : 3327 - 3331
  • [3] Head Pose Estimation Based on 3-D Facial Landmarks Localization and Regression
    Derkach, Dmytro
    Ruiz, Adria
    Sukno, Federico M.
    2017 12TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2017), 2017, : 820 - 827
  • [4] A 3D Approach to Facial Landmarks: Detection, Refinement, and Tracking
    Cech, Jan
    Franc, Vojtech
    Matas, Jiri
    2014 22ND INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2014, : 2173 - 2178
  • [5] Facial Action Unit Detection using 3D Face Landmarks for Pain Detection
    Feghoul, Kevin
    Bouazizi, Mondher
    Maia, Deise Santana
    2023 45TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY, EMBC, 2023,
  • [6] Improving calibration of 3-D video oculograpby systems
    Schreiber, K
    Haslwanter, T
    IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2004, 51 (04) : 676 - 679
  • [7] Exploring coordinated motion patterns of facial landmarks for deepfake video detection
    Zhang, Yue
    Niu, Run
    Zhang, Xianlin
    Chen, Siqi
    Wang, Mingdao
    Li, Xueming
    APPLIED SOFT COMPUTING, 2025, 174
  • [8] Automatic Neurocranial Landmarks Detection from Visible Facial Landmarks Leveraging 3D Head Priors
    Schlesinger, Oded
    Kundu, Raj
    Goetz, Stefan
    Sapiro, Guillermo
    Peterchev, Angel V.
    Di Martino, J. Matias
    CLINICAL IMAGE-BASED PROCEDURES, FAIRNESS OF AI IN MEDICAL IMAGING, AND ETHICAL AND PHILOSOPHICAL ISSUES IN MEDICAL IMAGING, CLIP 2023, FAIMI 2023, EPIMI 2023, 2023, 14242 : 12 - 20
  • [9] 3-D facial animation for very low bit rate mobile video
    Worrall, ST
    Sadka, AH
    Kondoz, AM
    THIRD INTERNATIONAL CONFERENCE ON 3G MOBILE COMMUNICATION TECHNOLOGIES, 2002, (489): : 371 - 375
  • [10] Infinite 3D Landmarks: Improving Continuous 2D Facial Landmark Detection
    Chandran, P.
    Zoss, G.
    Gotardo, P.
    Bradley, D.
    COMPUTER GRAPHICS FORUM, 2024, 43 (06)