3-D Facial Landmarks Detection for Intelligent Video Systems

被引:14
|
作者
Hoang, Van-Thanh [1 ]
Huang, De-Shuang [2 ]
Jo, Kang-Hyun [3 ,4 ]
机构
[1] Univ Ulsan, Grad Sch Elect Engn, Elect & Comp Engn, Ulsan 44610, South Korea
[2] Tongji Univ, Sch Elect & Informat Engn, Inst Machine Learning & Syst Biol, Shanghai 201804, Peoples R China
[3] Tongji Univ, Shanghai, Peoples R China
[4] Univ Ulsan, Sch Elect Engn, Ulsan, South Korea
关键词
Face; Three-dimensional displays; Detectors; Computer architecture; Convolution; Task analysis; Computational modeling; Convolution block; convolutional neural network (CNN); facial landmarks; stacked hourglass;
D O I
10.1109/TII.2020.2966513
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Facial landmark detection is a fundamental research topic in computer vision that is widely adopted in many applications. Recently, thanks to the development of convolutional neural networks, this topic has been largely improved. This article proposes facial-landmark detector, which is based on a state-of-the-art architecture for landmark localization called stacked hourglass network, to obtain accurate facial landmark-points. More specifically, this article uses residual networks as the backbone instead of a 7 x 7 convolution layer. Additionally, it modifies the hourglass modules by using the residual-dense blocks in the mainstream for capturing more efficient features and the 1 x 1 convolution layers in the branch streams for reducing the model size and computational time, instead of the original residual blocks. The proposed architecture also enhances the features from modified hourglass modules with finer-resolution features via a lateral connection to generate more accurate results. The proposed network can outperform other state-of-the-art methods on the AFLW2000-3D dataset and the LS3D-W dataset, the largest three-dimensional (3-D face) alignment dataset to date.
引用
收藏
页码:578 / 586
页数:9
相关论文
共 50 条
  • [21] Design Techniques for Planning Navigational Systems in 3-D Video Games
    Moura, Dinara
    El-Nasr, Magy Seif
    COMPUTERS IN ENTERTAINMENT, 2014, 12 (02)
  • [22] A new method for facial landmarks detection
    Peng, Xiaoning
    Zou, Beiji
    Wang, Lei
    CHINESE JOURNAL OF ELECTRONICS, 2009, 18 (01): : 74 - 78
  • [23] Automated Detection of Cat Facial Landmarks
    Martvel, George
    Shimshoni, Ilan
    Zamansky, Anna
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024, 132 (08) : 3103 - 3118
  • [24] 3D facial expression modeling based on facial landmarks in single image
    Lv, Chenlei
    Wu, Zhongke
    Wang, Xingce
    Zhou, Mingquan
    NEUROCOMPUTING, 2019, 355 : 155 - 167
  • [25] Fast and automatic facial feature extraction for 3-D model-based video coding
    Sheng, Y
    Sadka, AH
    Kondoz, AM
    Digital Media: Processing Multimedia Interactive Services, 2003, : 387 - 390
  • [26] REGISTRATION OF 3-D HEAD SURFACES USING MULTIPLE LANDMARKS
    FRIGHT, WR
    LINNEY, AD
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 1993, 12 (03) : 515 - 520
  • [27] Approaches to 3-D Video Compression
    Han, Seung-Ryong
    Yamasaki, Toshihiko
    Aizawa, Kiyoharu
    VISUAL COMMUNICATIONS AND IMAGE PROCESSING 2010, 2010, 7744
  • [28] Attitude Correction Using Corner Landmarks in 3-D SLAM
    Zhu, Zhen
    De Haag, Maarten Uijt
    IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2018, 54 (02) : 923 - 931
  • [29] 3-D VIDEO RECONSTRUCTION FROM 2-D VIDEO
    Akay, Fatih
    Akbulut, Abdullah
    Telatar, Ziya
    2015 23RD SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2015, : 2434 - 2437
  • [30] A DEEP FACIAL LANDMARKS DETECTION WITH FACIAL CONTOUR AND FACIAL COMPONENTS CONSTRAINT
    Baddar, Wissam J.
    Son, Jisoo
    Kim, Dae Hoe
    Kim, Seong Tae
    Ro, Yong Man
    2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 3209 - 3213