3D facial expression reconstruction from video via SFM and dynamic texture mapping

被引：2
|
作者：
Zhang J. [1 ]
机构：
[1] Department of Mathematics, College of Science, Zhejiang University
来源：
Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics | 2010年 / 22卷 / 06期
关键词：
Eigenface; Optical flow; Radial basis function; Shape from motion(SFM); Singular value decomposition;
D O I：
10.3724/SP.J.1089.2010.10886
中图分类号：
学科分类号：
摘要：
We propose an automatic approach to reconstruct realistic 3D facial expressions from un-calibrated monocular video sequences with little constraint. By the approach, the affine rectified optical flow method is first used to track facial features automatically aligned with ASM algorithm in the first frame. Secondly, 3D personalized face model and 3D expressions are reconstructed by shape from motion algorithm with the help of a generic face. At last, dynamic texture mapping is applied instead of traditional static texture mapping to generate more realistic facial appearance. Furthermore, eigenface based image compression method is adopted to save the storage space while the image quality is well maintained. Experiments show that our approach can be applied to generate quite realistic 3D facial expressions while keeping high performance in both time and space domains.
引用
收藏
页码：949 / 958
页数：9
相关论文
共 16 条
  • [1] Parke F.I., Computer generated animation of faces, Proceedings of the ACM Annual Conference, pp. 451-457, (1972)
  • [2] Blanz V., Vetter T., A morphable model for the synthesis of 3D faces, Computer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, pp. 187-194, (1999)
  • [3] Deng Z.G., Bulut M., Neumann U., Et al., Automatic dynamic expression synthesis for speech animation, Proceedings of IEEE Computer Animation and Social Agents, pp. 267-274, (2004)
  • [4] Pighin F., Hecker J., Lischinski D., Et al., Synthesizing realistic facial expressions from photographs, Computer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, pp. 75-84, (1998)
  • [5] Mei L., Bao H., Peng Q., Quick customization of particular human face and muscle-driven expression animation, Journal of Computer-Aided Design & Computer Graphics, 13, 12, pp. 1077-1082, (2001)
  • [6] Wang K., Zheng N., 3D face modeling based on SFM algorithm, Chinese Journal of Computers, 28, 6, pp. 1048-1053, (2005)
  • [7] Su C., Zhuang Y., Huang L., Et al., Analysis-by-synthesis approach for facial modeling based on orthogonal images, Journal of Zhejiang University: Engineering Science, 39, 2, pp. 175-179, (2005)
  • [8] Zhang L., Snavely N., Curless B., Et al., Spacetime faces: high resolution capture for modeling and animation, ACM Transactions on Graphics, 23, 3, pp. 548-558, (2004)
  • [9] Amin S.H., Gillies D., Analysis of 3D face reconstruction, Proceedings of the 14th International Conference on Image Analysis and Processing, pp. 413-418, (2007)
  • [10] Fidaleo D., Medioni G., Model-assisted 3D face reconstruction from video, Lecture Notes in Computer Science, 4778, pp. 124-138, (2007)
12