Formant Frequency Tuning of Three-Dimensional MRI-Based Vocal Tracts for the Finite Element Synthesis of Vowels

被引:0
|
作者
Arnela, Marc [1 ]
Guasch, Oriol [1 ]
机构
[1] Univ Ramon Llull, Dept Engn, Human Environm Res HER Grp, Barcelona 08022, Catalonia, Spain
关键词
3D vocal tract; formant tuning; vocal tract acoustics; Finite Element Method; MRI; vowels; PROPAGATION MODES; WAVE-EQUATION; SIMULATIONS; ACOUSTICS; GEOMETRY;
D O I
10.1109/TASLP.2024.3402068
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Nowadays it is possible to acquire three-dimensional (3D) geometries of the vocal tract by means of Magnetic Resonance Imaging (MRI) and introduce them into a 3D acoustic model to obtain their frequency response. However, it is not yet feasible to consider small variations in these geometries to tune the formant frequencies and produce, for instance, specific voice or singing effects. This work presents a methodology for doing so. First, the 3D MRI-based vocal tract geometry is discretized into a set of cross-sections from which its 1D area function is calculated. A 1D tuning algorithm based on sensitivity functions is then used to iteratively perturb the area function until the desired target frequencies are obtained. The algorithm also allows to consider vocal tract length perturbations between cross-sections. Finally, a 3D vocal tract is reconstructed using the shape of the original cross-sections with the new areas, and the new spacing between cross-sections according to the computed length variations. In this way it is possible to produce voice and singing effects by tuning the first formants of vowels while keeping the high energy content of the spectrum of 3D models at a low computational cost. Several examples are presented, ranging from the shift to lower and higher frequencies of the first formant (F1) to the generation of formant clusters. The latter is the case of the singing formant, in which F3, F4 and F5 are grouped together, or the case of biphonic singing, where F2 and F3 form a single peak to generate an overtone above the fundamental frequency.
引用
收藏
页码:2790 / 2799
页数:10
相关论文
共 50 条
  • [1] MRI-Based Vocal Tract Representations for the Three-Dimensional Finite Element Synthesis of Diphthongs
    Arnela, Marc
    Dabbaghchian, Saeed
    Guasch, Oriol
    Engwall, Olov
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2019, 27 (12) : 2173 - 2182
  • [3] Two-dimensional vocal tracts with three-dimensional behavior in the numerical generation of vowels
    Arnela, Marc
    Guasch, Oriol
    JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2014, 135 (01): : 369 - 379
  • [4] Tuned two-dimensional vocal tracts with piriform fossae for the finite element simulation of vowels
    Arnela, Marc
    Urena, David
    JOURNAL OF SOUND AND VIBRATION, 2022, 537
  • [5] Tuned two-dimensional vocal tracts with piriform fossae for the finite element simulation of vowels
    Arnela, Marc
    Urena, David
    JOURNAL OF SOUND AND VIBRATION, 2022, 537
  • [6] FINITE ELEMENT GENERATION OF VOWEL SOUNDS USING DYNAMIC COMPLEX THREE-DIMENSIONAL VOCAL TRACTS
    Arnela, Marc
    Guasch, Oriol
    Dabbaghchian, Saeed
    Engwall, Olov
    PROCEEDINGS OF THE 23RD INTERNATIONAL CONGRESS ON SOUND AND VIBRATION: FROM ANCIENT TO MODERN ACOUSTICS, 2016,
  • [7] Vocal tract shape identification from formant frequency spectra - A simulation using three-dimensional boundary element models
    Kagawa, Y
    Ohtani, Y
    Shimoyama, R
    JOURNAL OF SOUND AND VIBRATION, 1997, 203 (04) : 581 - 596
  • [8] Finite Element Synthesis of Diphthongs Using Tuned Two-Dimensional Vocal Tracts
    Arnela, Marc
    Guasch, Oriol
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2017, 25 (10) : 2013 - 2023
  • [9] Three-dimensional dosimetry of TomoTherapy by MRI-based polymer gel technique
    Watanabe, Yoichi
    Gopishankar, N.
    JOURNAL OF APPLIED CLINICAL MEDICAL PHYSICS, 2011, 12 (01): : 14 - 27
  • [10] MRI-Based Three-Dimensional Modeling and Assessment of Epicardial Adipose Tissue
    Klingensmith, Jon D.
    Sop, Saygin
    Fernandez-del-Valle, Maria
    Mitra, Sunanda
    Naz, Mete
    Lee, H. Felix
    MEDICAL IMAGING 2018: BIOMEDICAL APPLICATIONS IN MOLECULAR, STRUCTURAL, AND FUNCTIONAL IMAGING, 2018, 10578