Automatic integrated analysis of jaw and lip movement in speech production

被引：1
|
作者：
Borghese, NA [1 ]
Ferrigno, G [1 ]
Redolfi, M [1 ]
Pedotti, A [1 ]
机构：
[1] POLITECN MILAN,FDN PROJUVENTUTE,CTR BIOINGN,I-20133 MILAN,ITALY
来源：
JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA | 1997年 / 101卷 / 01期
关键词：
D O I：
10.1121/1.419490
中图分类号：
O42 [声学];
学科分类号：
070206 ; 082403 ;
摘要：
A noninvasive methodology for studying the kinematics of speech production is presented. It is based on the tracking of very small and light passive markers attached to the subjects' face. Using a pair of TV cameras, the 3-D markers' positions are computed in real time, at a subpixel accuracy, by a dedicated hardware. From these data, the time course of a set of parameters which describe lip and jaw movement is computed; in addition, a semiautomatic procedure that identifies the exact onset and offset of the investigated sequences has been developed. To compare the results over different productions, a time normalization procedure based on a continuous inverse Fourier transform has been implemented. (C) 1997 Acoustical Society of America.
引用
收藏
页码：482 / 487
页数：6
相关论文
共 50 条
  • [41] Speech recognition technology combined with three dimensional lip movement
    Dept. of Info. Network Engineering, Kanagawa Institute of Technology, 1030 Shimo-ogino, Atsugi-shi, Kanagawa 243-0292, Japan
    Proc SPIE Int Soc Opt Eng, 1600, (95-102):
  • [42] Speech recognition technology combined with three dimensional lip movement
    Komiya, K
    Isikawa, R
    Momose, K
    THREE-DIMENSIONAL IMAGE CAPTURE AND APPLICATIONS IV, 2001, 4298 : 95 - 102
  • [43] Fully Automatic Assessment of Speech of Children with Cleft Lip and Palate
    Maier, Andreas
    Noeth, Elmar
    Batliner, Anton
    Nkenke, Emeka
    Schuster, Maria
    INFORMATICA-JOURNAL OF COMPUTING AND INFORMATICS, 2006, 30 (04): : 477 - 482
  • [44] Visual speech features representation for automatic lip-reading
    Sagheer, A
    Tsuruta, N
    Taniguchi, RK
    Maeda, S
    2005 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS 1-5: SPEECH PROCESSING, 2005, : 781 - 784
  • [45] Hand and lip desynchronization analysis in french cued speech: Automatic temporal segmentation of hand flow
    Aboutabit, Noureddine
    Beautemps, Denis
    Besacier, Laurent
    2006 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, VOLS 1-13, 2006, : 633 - 636
  • [46] Evaluation of speech intelligibility for children with cleft lip and palate by means of automatic speech recognition
    Schuster, Maria
    Maier, Andreas
    Haderlein, Tino
    Nkenke, Emeka
    Wohlleben, Ulrike
    Rosanowski, Frank
    Eysholdt, Ulrich
    Noeth, Elmar
    INTERNATIONAL JOURNAL OF PEDIATRIC OTORHINOLARYNGOLOGY, 2006, 70 (10) : 1741 - 1747
  • [47] UPPER LIP, LOWER LIP, AND JAW INTERACTIONS DURING SPEECH - COMMENTS ON EVIDENCE FROM REPETITION-TO-REPETITION VARIABILITY
    FOLKINS, JW
    BROWN, CK
    JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 1987, 82 (06): : 1919 - 1924
  • [48] AN INTEGRATED KNOWLEDGE BASE FOR SPEECH SYNTHESIS AND AUTOMATIC SPEECH RECOGNITION
    TATHAM, MAA
    JOURNAL OF PHONETICS, 1985, 13 (02) : 175 - 188
  • [49] LIP AND JAW COORDINATION DURING PRODUCTION OF F-V IN ENGLISH
    HASEGAWA, A
    MCCUTDHEON, MJ
    WOLF, MB
    FLETCHER, SG
    JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 1976, 59 : S85 - S85
  • [50] VARIABILITY OF LIP AND JAW MOVEMENTS IN CHILDREN AND ADULTS - IMPLICATIONS FOR THE DEVELOPMENT OF SPEECH MOTOR CONTROL
    SHARKEY, SG
    FOLKINS, JW
    JOURNAL OF SPEECH AND HEARING RESEARCH, 1985, 28 (01): : 8 - 15
12345