Efficient Learning of Transform-Domain LMS Filter Using Graph Laplacian

被引:3
|
作者
Batabyal, Tamal [1 ]
Weller, Daniel [2 ,3 ]
Kapur, Jaideep [1 ]
Acton, Scott T. [2 ]
机构
[1] Univ Virginia, Dept Neurol, Charlottesville, VA 22904 USA
[2] Univ Virginia, Dept Elect & Comp Engn, Charlottesville, VA 22904 USA
[3] KLA Corp, Ann Arbor, MI 48105 USA
关键词
Convergence; Autocorrelation; Mathematical models; Transforms; Neurons; Linear systems; Discrete cosine transforms; Graph Laplacian; graph learning; Hebb-least mean squares (LMS) learning; LMS filter; split preconditioner; unitary transform; ADAPTIVE FILTERS; ALGORITHMS;
D O I
10.1109/TNNLS.2022.3144637
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Transform-domain least mean squares (TDLMS) adaptive filters encompass the class of learning algorithms where the input data are subjected to a data-independent unitary transform followed by a power normalization stage as preprocessing steps. Because conventional transformations are not data-dependent, this preconditioning procedure was shown theoretically to improve the convergence of the least mean squares (LMS) filter only for certain classes of input data. So, one can tailor the transformation to the class of data. However, in reality, if the class of input data is not known beforehand, it is difficult to decide which transformation to use. Thus, there is a need to devise a learning framework to obtain such a preconditioning transformation using input data prior to applying on the input data. It is hypothesized that the underlying topology of the data affects the selection of the transformation. With the input modeled as a weighted finite graph, our method, called preconditioning using graph (PrecoG), adaptively learns the desired transform by recursive estimation of the graph Laplacian matrix. We show the efficacy of the transform as a generalized split preconditioner on a linear system of equations and in Hebbian-LMS learning models. In terms of the improvement of the condition number after applying the transformation, PrecoG performs significantly better than the existing state-of-the-art techniques that involve unitary and nonunitary transforms.
引用
收藏
页码:7608 / 7620
页数:13
相关论文
共 50 条
  • [31] Digital Image Watermarking Using Optimized Transform-Domain Approach
    Kallianpur, Akshay K.
    Bharath, M., V
    Manikantan, K.
    2015 IEEE UP SECTION CONFERENCE ON ELECTRICAL COMPUTER AND ELECTRONICS (UPCON), 2015,
  • [32] Speech bandwidth extension using transform-domain data hiding
    Phaneendra Kurada
    Sailaja Maruvada
    Koteswara Rao Sanagapallea
    International Journal of Speech Technology, 2019, 22 : 305 - 312
  • [33] Transform-Domain Federated Learning for Edge-Enabled IoT Intelligence
    Zhao, Lei
    Cai, Lin
    Lu, Wu-Sheng
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (07) : 6205 - 6220
  • [34] A transform domain LMS adaptive filter with variable step-size
    Bilcu, RC
    Kuosmanen, P
    Egiazarian, K
    IEEE SIGNAL PROCESSING LETTERS, 2002, 9 (02) : 51 - 53
  • [35] Analysis of the Transform Domain LMS algorithm with insufficient length adaptive filter
    Mayyas, K
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2005, 14 (03) : 469 - 481
  • [36] Stability and Convergence Analysis of Transform-Domain LMS Adaptive Filters With Second-Order Autoregressive Process
    Zhao, Shengkui
    Man, Zhihong
    Khoo, Suiyang
    Wu, Hong Ren
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2009, 57 (01) : 119 - 130
  • [37] A GRAPH LAPLACIAN MATRIX LEARNING METHOD FOR FAST IMPLEMENTATION OF GRAPH FOURIER TRANSFORM
    Lu, Keng-Shih
    Ortega, Antonio
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 1677 - 1681
  • [38] Probabilistic Analysis of Targeted Attacks Using Transform-Domain Adversarial Examples
    Yahya, Zakia
    Hassan, Muhammad
    Younis, Shahzad
    Shafique, Muhammad
    IEEE ACCESS, 2020, 8 : 33855 - 33869
  • [39] A method of speech periodicity enhancement using transform-domain signal decomposition
    Huang, Feng
    Lee, Tan
    Kleijn, W. Bastiaan
    Kong, Ying-Yee
    SPEECH COMMUNICATION, 2015, 67 : 102 - 112
  • [40] Denoising of 3D magnetic resonance images using non-local PCA and Transform-Domain Filter
    Kanwal, Laraib
    Shahid, Muhammad Usman
    PROCEEDINGS OF THE 2016 19TH INTERNATIONAL MULTI-TOPIC CONFERENCE (INMIC), 2016, : 394 - 398