Phase-aware music super-resolution using generative adversarial networks

被引:10
|
作者
Hu, Shichao [1 ]
Zhang, Bin [1 ]
Liang, Beici [1 ]
Zhao, Ethan [1 ]
Lui, Simon [1 ]
机构
[1] Tencent Mus Entertainment TME, Shenzhen 518057, Peoples R China
来源
关键词
Music super-resolution; Bandwidth expansion; Generative adversarial network; Phase estimation; BANDWIDTH EXTENSION; NARROW-BAND; SPEECH;
D O I
10.21437/Interspeech.2020-2605
中图分类号
R36 [病理学]; R76 [耳鼻咽喉科学];
学科分类号
100104 ; 100213 ;
摘要
Audio super-resolution is a challenging task of recovering the missing high-resolution features from a low-resolution signal. To address this, generative adversarial networks (GAN) have been used to achieve promising results by training the mappings between magnitudes of the low and high-frequency components. However, phase information is not well-considered for waveform reconstruction in conventional methods. In this paper, we tackle the problem of music super-resolution and conduct a thorough investigation on the importance of phase for this task. We use GAN to predict the magnitudes of the high-frequency components. The corresponding phase information can be extracted using either a GAN-based waveform synthesis system or a modified Griffin-Lim algorithm. Experimental results show that phase information plays an important role in the improvement of the reconstructed music quality. Moreover, our proposed method significantly outperforms other state-of-the-art methods in terms of objective evaluations.
引用
收藏
页码:4074 / 4078
页数:5
相关论文
共 50 条
  • [31] ID Preserving Face Super-Resolution Generative Adversarial Networks
    Li, Jinning
    Zhou, Yichen
    Ding, Jie
    Chen, Cen
    Yang, Xulei
    IEEE ACCESS, 2020, 8 : 138373 - 138381
  • [32] DPSRGAN: Dilation Patch Super-Resolution Generative Adversarial Networks
    Mirchandani, Kapil
    Chordiya, Kushal
    2021 6TH INTERNATIONAL CONFERENCE FOR CONVERGENCE IN TECHNOLOGY (I2CT), 2021,
  • [33] Generative Adversarial Networks and Perceptual Losses for Video Super-Resolution
    Lucas, Alice
    Lopez-Tapia, Santiago
    Molina, Rafael
    Katsaggelos, Aggelos K.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (07) : 3312 - 3327
  • [34] Hierarchical Generative Adversarial Networks for Single Image Super-Resolution
    Chen, Weimin
    Ma, Yuqing
    Liu, Xianglong
    Yuan, Yi
    2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2021), 2021, : 355 - 364
  • [35] Improving the spatial resolution of solar images using super-resolution diffusion generative adversarial networks
    Song, Wei
    Ma, Ying
    Sun, Haoying
    Zhao, Xiaobing
    Lin, Ganghua
    ASTRONOMY & ASTROPHYSICS, 2024, 686
  • [36] ARISGAN: Extreme super-resolution of arctic surface imagery using generative adversarial networks
    Au, Christian
    Tsamados, Michel
    Manescu, Petru
    Takao, So
    FRONTIERS IN REMOTE SENSING, 2024, 5
  • [37] Image super-resolution using progressive generative adversarial networks for medical image analysis
    Mahapatra, Dwarikanath
    Bozorgtabar, Behzad
    Garnavi, Rahil
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2019, 71 : 30 - 39
  • [38] Underwater Acoustic Image Enhancement by Using Fast Super-Resolution with Generative Adversarial Networks
    Bucci, Alessandro
    Topini, Alberto
    Franchi, Matteo
    Zacchini, Leonardo
    Secciani, Nicola
    Ridolfi, Alessandro
    GLOBAL OCEANS 2020: SINGAPORE - U.S. GULF COAST, 2020,
  • [39] Unsupervised Image Super-Resolution using Cycle-in-Cycle Generative Adversarial Networks
    Yuan, Yuan
    Liu, Siyuan
    Zhang, Jiawei
    Zhang, Yongbing
    Dong, Chao
    Lin, Liang
    PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, : 814 - 823
  • [40] Super-resolution PET imaging using a generative adversarial network
    Song, Tzu-An
    Chowdhury, Samadrita Roy
    El Fakhri, Georges
    Li, Quanzheng
    Dutta, Joyita
    JOURNAL OF NUCLEAR MEDICINE, 2019, 60