MANIFOLD LEARNING-SUPPORTED ESTIMATION OF RELATIVE TRANSFER FUNCTIONS FOR SPATIAL FILTERING

被引:2
|
作者
Brendel, Andreas [1 ]
Zeitler, Johannes [1 ]
Kellermann, Walter [1 ]
机构
[1] Friedrich Alexander Univ Erlangen Nurnberg, Multimedia Commun & Signal Proc, Cauerstr 7, D-91058 Erlangen, Germany
关键词
Manifold learning; variational autoencoder; relative transfer function; spatial filtering; unsupervised learning; ENHANCEMENT; SEPARATION;
D O I
10.1109/ICASSP43922.2022.9746045
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Many spatial filtering algorithms used for voice capture in, e.g., tele-conferencing applications, can benefit from or even rely on knowledge of Relative Transfer Functions (RTFs). Accordingly, many RTF estimators have been proposed which, however, suffer from performance degradation under acoustically adverse conditions or need prior knowledge on the properties of the interfering sources. While state-of-the-art RTF estimators ignore prior knowledge about the acoustic enclosure, audio signal processing algorithms for tele-conferencing equipment are often operating in the same or at least a similar acoustic enclosure, e.g., a car or an office, such that training data can be collected. In this contribution, we use such data to train Variational Autoencoders (VAEs) in an unsupervised manner and apply the trained VAEs to enhance imprecise RTF estimates. Furthermore, a hybrid between classic RTF estimation and the trained VAE is investigated. Comprehensive experiments with real-world data confirm the efficacy for the proposed method.
引用
收藏
页码:8792 / 8796
页数:5
相关论文
共 19 条
  • [1] Biaxial AOTF transfer functions for spatial image filtering
    Kupreychik, Maxim I.
    Chizhikov, Alexander I.
    Yushkov, Konstantin B.
    ADVANCED OPTICAL IMAGING TECHNOLOGIES V, 2023, 12316
  • [2] TRANSFER-FUNCTIONS AND SPATIAL-FILTERING IN GRATING INTERFEROMETERS
    LEITH, EN
    HERSHEY, R
    APPLIED OPTICS, 1985, 24 (02): : 237 - 239
  • [3] Interpolation of Head-Related Transfer Functions Using Manifold Learning
    Grijalva, Felipe
    Martini, Luiz Cesar
    Florencio, Dinei
    Goldenstein, Siome
    IEEE SIGNAL PROCESSING LETTERS, 2017, 24 (02) : 221 - 225
  • [4] A Microphone Array Beamforming Algorithm with Inverse Filtering of Relative Transfer Functions in Car Environments
    Han, Chul-Hee
    Kang, Hong-Goo
    Hwang, Youngsoo
    Youn, Dae-Hee
    JOURNAL OF THE ACOUSTICAL SOCIETY OF KOREA, 2006, 25 (01): : 30 - 35
  • [5] New loss functions to improve deep learning estimation of heat transfer
    Mohammad Edalatifar
    Mohammad Ghalambaz
    Mohammad Bagher Tavakoli
    Farbod Setoudeh
    Neural Computing and Applications, 2022, 34 : 15889 - 15906
  • [6] New loss functions to improve deep learning estimation of heat transfer
    Edalatifar, Mohammad
    Ghalambaz, Mohammad
    Tavakoli, Mohammad Bagher
    Setoudeh, Farbod
    NEURAL COMPUTING & APPLICATIONS, 2022, 34 (18): : 15889 - 15906
  • [7] NARROWBAND DIRECTION-OF-ARRIVAL ESTIMATION FOR BINAURAL HEARING AIDS USING RELATIVE TRANSFER FUNCTIONS
    Braun, Sebastian
    Zhou, Wei
    Habets, Emanuel A. P.
    2015 IEEE WORKSHOP ON APPLICATIONS OF SIGNAL PROCESSING TO AUDIO AND ACOUSTICS (WASPAA), 2015,
  • [8] Estimation and Correction of Relative Transfer Function for Binaural Speech Separation Networks to Preserve Spatial Cues
    Feng, Zicheng
    Tsao, Yu
    Chen, Fei
    2021 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2021, : 1239 - 1244
  • [9] Estimation of state of charge integrating spatial and temporal characteristics with transfer learning optimization
    Zhang, Yiwei
    Liu, Kexin
    Chuang, Yutong
    Zhang, Jiusi
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2023, 34 (04)
  • [10] JOINT MAXIMUM LIKELIHOOD ESTIMATION OF POWER SPECTRAL DENSITIES AND RELATIVE ACOUSTIC TRANSFER FUNCTIONS FOR ACOUSTIC BEAMFORMING
    Hoang, Poul
    Tan, Zheng-Hua
    de Haan, Jan Mark
    Jensen, Jesper
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 6119 - 6123