Comparison of phoneme and viseme based acoustic units for speech driven realistic lip animation

被引：0
|
作者：
Bozkurt, Elif [1 ]
Erdem, Cigdem Eroglu [1 ]
Erzin, Engin [2 ]
Erdem, T. [1 ]
Oezkan, Mehmet [1 ]
机构：
[1] TUBITAK MAM TEKSEB, A-205, Gebze, Kocaeli, Turkey
[2] Koc Univ, Dept Elect & Elect Engn, Istanbul, Turkey
来源：
2007 IEEE 15TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS, VOLS 1-3 | 2007年
关键词：
D O I：
暂无
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
Natural looking lip animation, synchronized with incoming speech, is essential for realistic character animation. In this work, we evaluate the performance of phone and viseme based acoustic units, with and without context information, for generating realistic lip synchronization using HMM based recognition systems. We conclude via objective evaluations that utilization of viseme based units with context information outperforms the other methods.
引用
收藏
页码：422 / +
页数：2
相关论文
共 50 条
  • [1] Comparison of phoneme and viseme based acoustic units for speech driven realistic lip animation
    Bozkurt, Elif
    Erdem, Cigdem Eroglu
    Erzin, Engin
    Erdem, Tanju
    Oezkan, Mehmet
    2007 3DTV CONFERENCE, 2007, : 85 - +
  • [2] Using viseme based acoustic models for speech driven lip synthesis
    Verma, A
    Rajput, N
    Subramaniam, LV
    2003 INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOL III, PROCEEDINGS, 2003, : 533 - 536
  • [3] Using viseme based acoustic models for speech driven lip synthesis
    Verma, A
    Rajput, N
    Subramaniam, LV
    2003 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOL V, PROCEEDINGS: SENSOR ARRAY & MULTICHANNEL SIGNAL PROCESSING AUDIO AND ELECTROACOUSTICS MULTIMEDIA SIGNAL PROCESSING, 2003, : 720 - 723
  • [4] Acoustic driven viseme identification for face animation
    Zhong, JL
    Chou, W
    Petajan, E
    1997 IEEE FIRST WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING, 1997, : 7 - 12
  • [5] FRAMEWORK DEVELOPMENT OF REAL-TIME LIP SYNC ANIMATION ON VISEME BASED HUMAN SPEECH
    Hoon, Loh Ngiik
    Rahman, Khairul Aidil Azlin Abd.
    Chai, Wang Yin
    JURNAL TEKNOLOGI, 2015, 75 (04): : 43 - 48
  • [6] A comparison of acoustic coding models for speech-driven facial animation
    Kakumanu, Praveen
    Esposito, Anna
    Garcia, Oscar N.
    Gutierrez-Osuna, Ricardo
    SPEECH COMMUNICATION, 2006, 48 (06) : 598 - 615
  • [7] Automated lip synchronized speech driven facial animation
    Melek, Z
    Akarun, L
    2000 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, PROCEEDINGS VOLS I-III, 2000, : 623 - 626
  • [8] Speech-driven facial animation with realistic dynamics
    Gutierrez-Osuna, R
    Kakumanu, PK
    Esposito, A
    Garcia, ON
    Bojorquez, A
    Castillo, JL
    Rudomin, I
    IEEE TRANSACTIONS ON MULTIMEDIA, 2005, 7 (01) : 33 - 42
  • [9] Realistic Speech-Driven Facial Animation with GANs
    Vougioukas, Konstantinos
    Petridis, Stavros
    Pantic, Maja
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2020, 128 (05) : 1398 - 1413
  • [10] Realistic Speech-Driven Facial Animation with GANs
    Konstantinos Vougioukas
    Stavros Petridis
    Maja Pantic
    International Journal of Computer Vision, 2020, 128 : 1398 - 1413
12345