Interpretable and Learnable Super-Resolution Time-Frequency Representation

被引:0
|
作者
Balestriero, Randall [1 ]
Glotin, Herve [2 ,3 ]
Baraniuk, Richard G. [1 ]
机构
[1] Rice Univ, ECE Dept, Houston, TX 77005 USA
[2] Univ Toulon & Var, Toulon, France
[3] Aix Marseille Univ, CNRS, LIS, DYNI,INPS, Marseille, France
关键词
Learnable Time-Frequency Representation; Time-Series; Cohen Class; Wigner-Ville; Spectrogram; Wavelet; Chirplet; Gabor Transform; Audio Classification; Interpretability; Explainability; Super-Resolution; Speech Recognition; Environmental Sounds; biosonar; bioacoustics; WIGNER DISTRIBUTION; COMPRESSION;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We develop a novel interpretable and learnable time-frequency representation (TFR) that produces a super-resolved quadratic signal representation for time-series analysis; the proposed TFR is a Gaussian filtering of the Wigner-Ville (WV) transform of a signal parametrized with a few interpretable parameters. Our approach has two main hallmarks. First, by varying the filters applied onto the WV, our new TFR can interpolate between known TFRs such as spectrograms, wavelet transforms, and chirplet transforms. Beyond that, our representation can also reach perfect time and frequency localization, hence super-resolution; this generalizes standard TFRs whose resolution is limited by the Heisenberg uncertainty principle. Second, our proposed TFR is interpretable thanks to an explicit low-dimensional and physical parametrization of the WV Gaussian filtering. We demonstrate that our approach enables us to learn highly adapted TFRs and is able to tackle a range of large-scale classification tasks, where we reach higher performance compared to baseline and learned TFRs. Ours is to the best of our knowledge the first learnable TFR that can continuously interpolate between super-resolution representation and commonly employed TFRs based on a few learnable parameters and which preserves full interpretability of the produced TFR, even after learning.
引用
收藏
页码:118 / 152
页数:35
相关论文
共 50 条
  • [21] Super-resolution with Nonlocal Regularized Sparse Representation
    Dong, Weisheng
    Shi, Guangming
    Zhang, Lei
    Wu, Xiaolin
    VISUAL COMMUNICATIONS AND IMAGE PROCESSING 2010, 2010, 7744
  • [22] Progressive representation recalibration for lightweight super-resolution
    Wen, Ruimian
    Yang, Zhijing
    Chen, Tianshui
    Li, Hao
    Li, Kai
    NEUROCOMPUTING, 2022, 504 : 240 - 250
  • [23] Unified Interpretable Deep Network for Joint Super-Resolution and Pansharpening
    Yu, Dian
    Zhang, Wei
    Xu, Mingzhu
    Tian, Xin
    Jiang, Hao
    REMOTE SENSING, 2024, 16 (03)
  • [24] Image Super-Resolution Via Sparse Representation
    Yang, Jianchao
    Wright, John
    Huang, Thomas S.
    Ma, Yi
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2010, 19 (11) : 2861 - 2873
  • [25] Improved Sparse Representation based Super-Resolution
    Kumar, Ravi Ranjan
    Mishra, Deepasikha
    2016 INTERNATIONAL CONFERENCE ON ELECTRICAL, ELECTRONICS, AND OPTIMIZATION TECHNIQUES (ICEEOT), 2016, : 2265 - 2270
  • [26] Interpretable Deep Learning for Multimodal Super-Resolution of Medical Images
    Tsiligianni, Evaggelia
    Zerva, Matina
    Marivani, Iman
    Deligiannis, Nikos
    Kondi, Lisimachos
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT VI, 2021, 12906 : 421 - 429
  • [27] Face Super-Resolution by Deep Collaborative Representation
    Lu T.
    Pan L.
    Guan Y.
    Zeng K.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2019, 31 (04): : 596 - 601
  • [28] High-resolution time-frequency representation with generative adversarial networks
    Deprem, Zeynel
    Cetin, A. Enis
    SIGNAL IMAGE AND VIDEO PROCESSING, 2023, 17 (03) : 849 - 854
  • [29] High-resolution ground motion generation with time-frequency representation
    Xu, Zekun
    Chen, Jun
    BULLETIN OF EARTHQUAKE ENGINEERING, 2024, 22 (08) : 3703 - 3726
  • [30] A high-resolution time-frequency representation for musical instrument signals
    Pielemeier, WJ
    Wakefield, GH
    JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 1996, 99 (04): : 2382 - 2396