Formant Frequency Tuning of Three-Dimensional MRI-Based Vocal Tracts for the Finite Element Synthesis of Vowels

被引:0
|
作者
Arnela, Marc [1 ]
Guasch, Oriol [1 ]
机构
[1] Univ Ramon Llull, Dept Engn, Human Environm Res HER Grp, Barcelona 08022, Catalonia, Spain
关键词
3D vocal tract; formant tuning; vocal tract acoustics; Finite Element Method; MRI; vowels; PROPAGATION MODES; WAVE-EQUATION; SIMULATIONS; ACOUSTICS; GEOMETRY;
D O I
10.1109/TASLP.2024.3402068
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Nowadays it is possible to acquire three-dimensional (3D) geometries of the vocal tract by means of Magnetic Resonance Imaging (MRI) and introduce them into a 3D acoustic model to obtain their frequency response. However, it is not yet feasible to consider small variations in these geometries to tune the formant frequencies and produce, for instance, specific voice or singing effects. This work presents a methodology for doing so. First, the 3D MRI-based vocal tract geometry is discretized into a set of cross-sections from which its 1D area function is calculated. A 1D tuning algorithm based on sensitivity functions is then used to iteratively perturb the area function until the desired target frequencies are obtained. The algorithm also allows to consider vocal tract length perturbations between cross-sections. Finally, a 3D vocal tract is reconstructed using the shape of the original cross-sections with the new areas, and the new spacing between cross-sections according to the computed length variations. In this way it is possible to produce voice and singing effects by tuning the first formants of vowels while keeping the high energy content of the spectrum of 3D models at a low computational cost. Several examples are presented, ranging from the shift to lower and higher frequencies of the first formant (F1) to the generation of formant clusters. The latter is the case of the singing formant, in which F3, F4 and F5 are grouped together, or the case of biphonic singing, where F2 and F3 form a single peak to generate an overtone above the fundamental frequency.
引用
收藏
页码:2790 / 2799
页数:10
相关论文
共 50 条
  • [11] Three-dimensional tuning of idiophone bar modes via finite element analysisa)
    Beaton, Douglas
    Scavone, Gary
    JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2021, 149 (06): : 3758 - 3768
  • [13] A Frequency Domain Finite Element Approach for Three-Dimensional Gear Dynamics
    Cooley, Christopher G.
    Parker, Robert G.
    Vijayakar, Sandeep M.
    JOURNAL OF VIBRATION AND ACOUSTICS-TRANSACTIONS OF THE ASME, 2011, 133 (04):
  • [14] A FREQUENCY DOMAIN FINITE ELEMENT APPROACH FOR THREE-DIMENSIONAL GEAR DYNAMICS
    Cooley, Christopher G.
    Parker, Robert G.
    Vijayakar, Sandeep M.
    DETC2009: PROCEEDINGS OF THE ASME INTERNATIONAL DESIGN ENGINEERING TECHNICAL CONFERENCES/COMPUTERS AND INFORMATION IN ENGINEERING CONFERENCE, 2010, : 205 - 215
  • [15] Prediction of Three-Dimensional Milling Forces Based on Finite Element
    Zhu, Lida
    Zhu, Chunxia
    Pei, Jiaying
    Li, Xuebing
    Wang, Wei
    ADVANCES IN MATERIALS SCIENCE AND ENGINEERING, 2014, 2014
  • [16] A parametric three-dimensional model of the vocal-tract based on MRI data
    Yehia, H
    Tiede, M
    1997 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS I - V: VOL I: PLENARY, EXPERT SUMMARIES, SPECIAL, AUDIO, UNDERWATER ACOUSTICS, VLSI; VOL II: SPEECH PROCESSING; VOL III: SPEECH PROCESSING, DIGITAL SIGNAL PROCESSING; VOL IV: MULTIDIMENSIONAL SIGNAL PROCESSING, NEURAL NETWORKS - VOL V: STATISTICAL SIGNAL AND ARRAY PROCESSING, APPLICATIONS, 1997, : 1619 - 1622
  • [17] MRI-based three-dimensional thermal physiological characterization of thyroid gland of human body
    Jin, Chao
    He, Zhi Zhu
    Yang, Yang
    Liu, Jing
    MEDICAL ENGINEERING & PHYSICS, 2014, 36 (01) : 16 - 25
  • [18] The three-dimensional beam theory: Finite element formulation based on curvature
    Zupan, D
    Saje, M
    COMPUTERS & STRUCTURES, 2003, 81 (18-19) : 1875 - 1888
  • [19] Three-dimensional inversion of magnetotelluric based on adaptive finite element method
    Qin Ce
    Liu XingFei
    Wang XuBen
    Sun WeiBin
    Zhao Ning
    CHINESE JOURNAL OF GEOPHYSICS-CHINESE EDITION, 2022, 65 (06): : 2311 - 2325
  • [20] Three-dimensional Solid Element Based on the Finite Element Absolute Nodal Coordinate Formulation
    Chao, Ma
    Hao, Liu
    Yang, Zhao
    PROCEEDINGS OF THE 2016 4TH INTERNATIONAL CONFERENCE ON ELECTRICAL & ELECTRONICS ENGINEERING AND COMPUTER SCIENCE (ICEEECS 2016), 2016, 50 : 320 - 323