WHAMR!: NOISY AND REVERBERANT SINGLE-CHANNEL SPEECH SEPARATION

被引:0
|
作者
Maciejewski, Matthew [1 ,2 ]
Wichern, Gordon [1 ]
McQuinn, Emmett [3 ]
Le Roux, Jonathan [1 ]
机构
[1] Mitsubishi Elect Res Labs MERL, Cambridge, MA 02139 USA
[2] Johns Hopkins Univ, Baltimore, MD 21218 USA
[3] Whisperai, San Francisco, CA USA
关键词
speech separation; speech enhancement; cocktail party problem; reverberation;
D O I
10.1109/icassp40776.2020.9053327
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
While significant advances have been made with respect to the separation of overlapping speech signals, studies have been largely constrained to mixtures of clean, near anechoic speech, not representative of many real-world scenarios. Although the WHAM! dataset introduced noise to the ubiquitous wsj0-2mix dataset, it did not include reverberation, which is generally present in indoor recordings outside of recording studios. The spectral smearing caused by reverberation can result in significant performance degradation for standard deep learning-based speech separation systems, which rely on spectral structure and the sparsity of speech signals to tease apart sources. To address this, we introduce WHAMR!, an augmented version of WHAM! with synthetic reverberated sources, and provide a thorough baseline analysis of current techniques as well as novel cascaded architectures on the newly introduced conditions.
引用
收藏
页码:696 / 700
页数:5
相关论文
共 50 条
  • [1] GLMSNET: SINGLE CHANNEL SPEECH SEPARATION FRAMEWORK IN NOISY AND REVERBERANT ENVIRONMENTS
    Shi, Huiyu
    Chen, Xi
    Kong, Tianlong
    Yin, Shouyi
    Ouyang, Peng
    2021 IEEE AUTOMATIC SPEECH RECOGNITION AND UNDERSTANDING WORKSHOP (ASRU), 2021, : 663 - 670
  • [2] Combination of MVDR beamforming and single-channel spectral processing for enhancing noisy and reverberant speech
    Cauchi, Benjamin
    Kodrasi, Ina
    Rehr, Robert
    Gerlach, Stephan
    Jukic, Ante
    Gerkmann, Timo
    Doclo, Simon
    Goetze, Stefan
    EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING, 2015,
  • [3] Combination of MVDR beamforming and single-channel spectral processing for enhancing noisy and reverberant speech
    Benjamin Cauchi
    Ina Kodrasi
    Robert Rehr
    Stephan Gerlach
    Ante Jukić
    Timo Gerkmann
    Simon Doclo
    Stefan Goetze
    EURASIP Journal on Advances in Signal Processing, 2015
  • [4] TRAINING NOISY SINGLE-CHANNEL SPEECH SEPARATION WITH NOISY ORACLE SOURCES: A LARGE GAP AND A SMALL STEP
    Maciejewski, Matthew
    Shi, Jing
    Watanabe, Shinji
    Khudanpur, Sanjeev
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 5774 - 5778
  • [5] A comprehensive study on supervised single-channel noisy speech separation with multi-task learning
    Dang, Shaoxiang
    Matsumoto, Tetsuya
    Takeuchi, Yoshinori
    Kudo, Hiroaki
    SPEECH COMMUNICATION, 2025, 167
  • [6] Speaker Counting and Separation From Single-Channel Noisy Mixtures
    Chetupalli, Srikanth Raj
    Habets, Emanuel A. P.
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2023, 31 : 1681 - 1692
  • [7] Self-Attention for Multi-Channel Speech Separation in Noisy and Reverberant Environments
    Liu, Conggui
    Sato, Yoshinao
    2020 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2020, : 794 - 799
  • [8] JOINT SINGLE-CHANNEL SPEECH SEPARATION AND SPEAKER IDENTIFICATION
    Mowlaee, P.
    Saeidi, R.
    Tan, Z. -H.
    Christensen, M. G.
    Franti, P.
    Jensen, S. H.
    2010 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2010, : 4430 - 4433
  • [9] LEARNING A HIERARCHICAL DICTIONARY FOR SINGLE-CHANNEL SPEECH SEPARATION
    Bao, Guangzhao
    Xu, Yangfei
    Xu, Xu
    Ye, Zhongfu
    2014 IEEE WORKSHOP ON STATISTICAL SIGNAL PROCESSING (SSP), 2014, : 476 - 479
  • [10] Improved Phase Reconstruction in Single-Channel Speech Separation
    Mayer, Florian
    Mowlaee, Pejman
    16TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2015), VOLS 1-5, 2015, : 1795 - 1799