Interpretable and Learnable Super-Resolution Time-Frequency Representation

被引:0
|
作者
Balestriero, Randall [1 ]
Glotin, Herve [2 ,3 ]
Baraniuk, Richard G. [1 ]
机构
[1] Rice Univ, ECE Dept, Houston, TX 77005 USA
[2] Univ Toulon & Var, Toulon, France
[3] Aix Marseille Univ, CNRS, LIS, DYNI,INPS, Marseille, France
关键词
Learnable Time-Frequency Representation; Time-Series; Cohen Class; Wigner-Ville; Spectrogram; Wavelet; Chirplet; Gabor Transform; Audio Classification; Interpretability; Explainability; Super-Resolution; Speech Recognition; Environmental Sounds; biosonar; bioacoustics; WIGNER DISTRIBUTION; COMPRESSION;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We develop a novel interpretable and learnable time-frequency representation (TFR) that produces a super-resolved quadratic signal representation for time-series analysis; the proposed TFR is a Gaussian filtering of the Wigner-Ville (WV) transform of a signal parametrized with a few interpretable parameters. Our approach has two main hallmarks. First, by varying the filters applied onto the WV, our new TFR can interpolate between known TFRs such as spectrograms, wavelet transforms, and chirplet transforms. Beyond that, our representation can also reach perfect time and frequency localization, hence super-resolution; this generalizes standard TFRs whose resolution is limited by the Heisenberg uncertainty principle. Second, our proposed TFR is interpretable thanks to an explicit low-dimensional and physical parametrization of the WV Gaussian filtering. We demonstrate that our approach enables us to learn highly adapted TFRs and is able to tackle a range of large-scale classification tasks, where we reach higher performance compared to baseline and learned TFRs. Ours is to the best of our knowledge the first learnable TFR that can continuously interpolate between super-resolution representation and commonly employed TFRs based on a few learnable parameters and which preserves full interpretability of the produced TFR, even after learning.
引用
收藏
页码:118 / 152
页数:35
相关论文
共 50 条
  • [41] High Resolution Time-Frequency Distribution Based on Short-Time Sparse Representation
    Liu, Zhen
    You, Peng
    Wei, Xizhang
    Liao, Dongping
    Li, Xiang
    CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2014, 33 (12) : 3949 - 3965
  • [42] Space-time super-resolution
    Shechtman, E
    Caspi, Y
    Irani, M
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2005, 27 (04) : 531 - 545
  • [43] Massive Parallel Computing of Super-Resolution with Sparse Representation
    Ding, Hao-Rong
    Kuo, Chih-Hung
    Kuo, Po-Hung
    Chuang, Yan-Tse
    INTELLIGENT SYSTEMS AND APPLICATIONS (ICS 2014), 2015, 274 : 1043 - 1051
  • [44] Image super-resolution via adaptive sparse representation
    Zhao, Jianwei
    Hu, Heping
    Cao, Feilong
    KNOWLEDGE-BASED SYSTEMS, 2017, 124 : 23 - 33
  • [45] Super-Resolution of Medical Image Using Representation Learning
    Yang, Xiong
    Zhan, Shu
    Hu, Changsheng
    Liang, Zhicheng
    Xie, Dongdong
    2016 8TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS & SIGNAL PROCESSING (WCSP), 2016,
  • [46] Face super-resolution via nonlinear adaptive representation
    Lu, Tao
    Zeng, Kangli
    Qu, Shenming
    Zhang, Yanduo
    He, Wei
    NEURAL COMPUTING & APPLICATIONS, 2020, 32 (15): : 11637 - 11649
  • [47] Sparse Representation to Solve the Problem of Image Super-Resolution
    Alvarez-Ramos, Valentin
    Ponomaryov, Volodymyr
    2016 INTERNATIONAL CONFERENCE ON ELECTRONICS, COMMUNICATIONS AND COMPUTERS (CONIELECOMP), 2016, : 156 - 161
  • [48] Optimized image super-resolution based on sparse representation
    Zhu, Yanming
    Jiang, Jianmin
    Li, Kun
    2012 21ST INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR 2012), 2012, : 1052 - 1055
  • [49] Fast Super-Resolution based on Weighted Collaborative Representation
    Li, Hailiang
    Lam, Kin-Man
    2014 19TH INTERNATIONAL CONFERENCE ON DIGITAL SIGNAL PROCESSING (DSP), 2014, : 914 - 918
  • [50] Frequency Separation Network for Image Super-Resolution
    Li, Shanshan
    Cai, Qiang
    Li, Haisheng
    Cao, Jian
    Wang, Lei
    Li, Zhuangzi
    IEEE ACCESS, 2020, 8 : 33768 - 33777