Interpretable and Learnable Super-Resolution Time-Frequency Representation

被引:0
|
作者
Balestriero, Randall [1 ]
Glotin, Herve [2 ,3 ]
Baraniuk, Richard G. [1 ]
机构
[1] Rice Univ, ECE Dept, Houston, TX 77005 USA
[2] Univ Toulon & Var, Toulon, France
[3] Aix Marseille Univ, CNRS, LIS, DYNI,INPS, Marseille, France
关键词
Learnable Time-Frequency Representation; Time-Series; Cohen Class; Wigner-Ville; Spectrogram; Wavelet; Chirplet; Gabor Transform; Audio Classification; Interpretability; Explainability; Super-Resolution; Speech Recognition; Environmental Sounds; biosonar; bioacoustics; WIGNER DISTRIBUTION; COMPRESSION;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We develop a novel interpretable and learnable time-frequency representation (TFR) that produces a super-resolved quadratic signal representation for time-series analysis; the proposed TFR is a Gaussian filtering of the Wigner-Ville (WV) transform of a signal parametrized with a few interpretable parameters. Our approach has two main hallmarks. First, by varying the filters applied onto the WV, our new TFR can interpolate between known TFRs such as spectrograms, wavelet transforms, and chirplet transforms. Beyond that, our representation can also reach perfect time and frequency localization, hence super-resolution; this generalizes standard TFRs whose resolution is limited by the Heisenberg uncertainty principle. Second, our proposed TFR is interpretable thanks to an explicit low-dimensional and physical parametrization of the WV Gaussian filtering. We demonstrate that our approach enables us to learn highly adapted TFRs and is able to tackle a range of large-scale classification tasks, where we reach higher performance compared to baseline and learned TFRs. Ours is to the best of our knowledge the first learnable TFR that can continuously interpolate between super-resolution representation and commonly employed TFRs based on a few learnable parameters and which preserves full interpretability of the produced TFR, even after learning.
引用
收藏
页码:118 / 152
页数:35
相关论文
共 50 条
  • [31] High-resolution time-frequency representation with generative adversarial networks
    Zeynel Deprem
    A. Enis Çetin
    Signal, Image and Video Processing, 2023, 17 : 849 - 854
  • [32] Reference-Based OCT Angiogram Super-Resolution With Learnable Texture Generation
    Ruan, Yuyan
    Yang, Dawei
    Tang, Ziqi
    Ran, An Ran
    Wang, Jiguang
    Cheung, Carol Y.
    Chen, Hao
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024,
  • [33] Sparse Regularization With Learnable Partition Weights for Super-Resolution Imaging of Ultrawideband Radar
    Li, Rui
    Wang, Xueqian
    Li, Gang
    Zhang, Xiao-Ping
    IEEE TRANSACTIONS ON ANTENNAS AND PROPAGATION, 2025, 73 (02) : 1149 - 1161
  • [34] A Novel Learnable Interpolation Approach for Scale-Arbitrary Image Super-Resolution
    Chao, Jiahao
    Zhou, Zhou
    Gao, Hongfan
    Gong, Jiali
    Zeng, Zhenbing
    Yang, Zhengfeng
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 564 - 572
  • [35] Learnable adaptive bilateral filter for improved generalization in Single Image Super-Resolution
    Guo, Wenhao
    Lu, Peng
    Peng, Xujun
    Zhao, Zhaoran
    PATTERN RECOGNITION, 2025, 162
  • [36] FDSR: An Interpretable Frequency Division Stepwise Process Based Single-Image Super-Resolution Network
    Xu, Pengcheng
    Liu, Qun
    Bao, Huanan
    Zhang, Ruhui
    Gu, Lihua
    Wang, Guoyin
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 1710 - 1725
  • [37] FDSR: An Interpretable Frequency Division Stepwise Process Based Single-Image Super-Resolution Network
    Xu, Pengcheng
    Liu, Qun
    Bao, Huanan
    Zhang, Ruhui
    Gu, Lihua
    Wang, Guoyin
    IEEE Transactions on Image Processing, 2024, 33 : 1710 - 1725
  • [38] An Interpretable Method for Operational Modal Analysis in Time-Frequency Representation and Its Applications to Railway Sleepers
    Zeng, Yuanchen
    Shen, Chen
    Nunez, Alfredo
    Dollevoet, Rolf
    Zhang, Weihua
    Li, Zili
    STRUCTURAL CONTROL & HEALTH MONITORING, 2023, 2023
  • [39] High Resolution Time-Frequency Distribution Based on Short-Time Sparse Representation
    Zhen Liu
    Peng You
    Xizhang Wei
    Dongping Liao
    Xiang Li
    Circuits, Systems, and Signal Processing, 2014, 33 : 3949 - 3965
  • [40] Comments on "resolution in time-frequency"
    Knockaert, L
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2000, 48 (12) : 3585 - 3586