Efficient Learning of Transform-Domain LMS Filter Using Graph Laplacian

被引:3
|
作者
Batabyal, Tamal [1 ]
Weller, Daniel [2 ,3 ]
Kapur, Jaideep [1 ]
Acton, Scott T. [2 ]
机构
[1] Univ Virginia, Dept Neurol, Charlottesville, VA 22904 USA
[2] Univ Virginia, Dept Elect & Comp Engn, Charlottesville, VA 22904 USA
[3] KLA Corp, Ann Arbor, MI 48105 USA
关键词
Convergence; Autocorrelation; Mathematical models; Transforms; Neurons; Linear systems; Discrete cosine transforms; Graph Laplacian; graph learning; Hebb-least mean squares (LMS) learning; LMS filter; split preconditioner; unitary transform; ADAPTIVE FILTERS; ALGORITHMS;
D O I
10.1109/TNNLS.2022.3144637
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Transform-domain least mean squares (TDLMS) adaptive filters encompass the class of learning algorithms where the input data are subjected to a data-independent unitary transform followed by a power normalization stage as preprocessing steps. Because conventional transformations are not data-dependent, this preconditioning procedure was shown theoretically to improve the convergence of the least mean squares (LMS) filter only for certain classes of input data. So, one can tailor the transformation to the class of data. However, in reality, if the class of input data is not known beforehand, it is difficult to decide which transformation to use. Thus, there is a need to devise a learning framework to obtain such a preconditioning transformation using input data prior to applying on the input data. It is hypothesized that the underlying topology of the data affects the selection of the transformation. With the input modeled as a weighted finite graph, our method, called preconditioning using graph (PrecoG), adaptively learns the desired transform by recursive estimation of the graph Laplacian matrix. We show the efficacy of the transform as a generalized split preconditioner on a linear system of equations and in Hebbian-LMS learning models. In terms of the improvement of the condition number after applying the transformation, PrecoG performs significantly better than the existing state-of-the-art techniques that involve unitary and nonunitary transforms.
引用
收藏
页码:7608 / 7620
页数:13
相关论文
共 50 条
  • [1] Transform-domain delayed LMS algorithm and architecture
    Wu, AY
    Wu, CS
    ISCAS '98 - PROCEEDINGS OF THE 1998 INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOLS 1-6, 1998, : D194 - D197
  • [2] A fast wavelet transform-domain LMS algorithm
    Attallah, S
    Najim, M
    1996 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, CONFERENCE PROCEEDINGS, VOLS 1-6, 1996, : 1343 - 1346
  • [3] Stochastic modeling of the transform-domain εLMS algorithm
    Lobato, Elen Macedo
    Tobias, Orlando Jose
    Seara, Rui
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2008, 56 (05) : 1840 - 1852
  • [4] The variable step-size wavelet transform-domain LMS adaptive filter algorithm
    Abadi, M. Shams Esfand
    Mesgarani, H.
    Khademiyan, S. M.
    SCIENTIA IRANICA, 2020, 27 (03) : 1398 - 1412
  • [5] The wavelet transform-domain LMS adaptive filter with partial subband-coefficient updating
    Attallah, S
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2006, 53 (01) : 8 - 12
  • [6] The variable step-size wavelet transform-domain LMS adaptive filter algorithm
    Abadi M.S.E.
    Mesgarani H.
    Khademiyan S.M.
    Scientia Iranica, 2020, 27 (3 D) : 1398 - 1412
  • [7] QUANTIZATION EFFECTS IN TRANSFORM-DOMAIN NORMALIZED LMS ALGORITHM
    GAZOR, S
    FARHANGBOROUJENY, B
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-ANALOG AND DIGITAL SIGNAL PROCESSING, 1992, 39 (01): : 1 - 7
  • [8] The wavelet transform-domain LMS adaptive filter employing dynamic selection of subband-coefficients
    Abadi, Mohammad Shams Esfand
    Mesgarani, Hamid
    Khademiyan, Seyed Mahmoud
    DIGITAL SIGNAL PROCESSING, 2017, 69 : 94 - 105
  • [9] GSC REALIZATIONS USING THE 2-DIMENSIONAL TRANSFORM-DOMAIN LMS ALGORITHM
    AN, J
    CHAMPAGNE, B
    IEE PROCEEDINGS-RADAR SONAR AND NAVIGATION, 1994, 141 (05) : 270 - 278
  • [10] The wavelet transform-domain LMS algorithm: A more practical approach
    Attallah, S
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-ANALOG AND DIGITAL SIGNAL PROCESSING, 2000, 47 (03): : 209 - 213