Focused local learning with wavelet neural networks

被引:28
|
作者
Rying, EA
Bilbro, GL
Lu, JC
机构
[1] N Carolina State Univ, Dept Elect & Comp Engn, Raleigh, NC 27695 USA
[2] Georgia Inst Technol, Sch Ind & Syst Engn, Atlanta, GA 30332 USA
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2002年 / 13卷 / 02期
基金
美国国家科学基金会;
关键词
local error; objective function; wavelets;
D O I
10.1109/72.991417
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, a novel objective function is presented that incorporates both local and global error as well as model parsimony in the construction of wavelet neural networks. Two methods are presented to assist in the minimization of this objective function, especially the local error term. First, during network initialization, a locally adaptive grid is utilized to include candidate wavelet basis functions whose local support addresses the local error of the local feature set. This set can be either user-defined or determined using information derived from the wavelet transform modulus maxima (WTMM) representation. Second, during network construction, a new selection procedure based on a subspace projection operator is presented to help focus the selection of wavelet basis functions to reduce the local error. Simulation results demonstrate the effectiveness of these methodologies in minimizing local and global error while maintaining model parsimony and incurring a minimal increase on computational complexity.
引用
收藏
页码:304 / 319
页数:16
相关论文
共 50 条
  • [21] Fuzzy wavelet neural networks control based on hybrid learning algorithm
    College of Electrical and Information Engineering, Hunan Univ., Changsha 410082, China
    Hunan Daxue Xuebao, 2006, 2 (51-54):
  • [22] Distributed wavelet neural networks
    Wangzhuo Yang
    Bo Chen
    Li Yu
    Applied Intelligence, 2022, 52 : 8735 - 8745
  • [23] Wavelet Probabilistic Neural Networks
    Garcia-Trevino, Edgar S.
    Yang, Pu
    Barria, Javier A.
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (01) : 376 - 389
  • [24] Distributed wavelet neural networks
    Yang, Wangzhuo
    Chen, Bo
    Yu, Li
    APPLIED INTELLIGENCE, 2022, 52 (08) : 8735 - 8745
  • [25] Wavelet networks: An alternative to classical neural networks
    Parasuraman, K
    Elshorbagy, A
    PROCEEDINGS OF THE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), VOLS 1-5, 2005, : 2674 - 2679
  • [26] Local feedback adjustment in neural networks with projection learning algorithm
    Reznik, AM
    Gorodnichii, DO
    Sychev, AS
    CYBERNETICS AND SYSTEMS ANALYSIS, 1996, 32 (06) : 868 - 875
  • [27] Contextualized Non-Local Neural Networks for Sequence Learning
    Liu, Pengfei
    Chang, Shuaichen
    Huang, Xuanjing
    Tang, Jian
    Cheung, Jackie Chi Kit
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 6762 - 6769
  • [28] Temporal Dependent Local Learning for Deep Spiking Neural Networks
    Ma, Chenxiang
    Xu, Junhai
    Yu, Qiang
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [29] Learning the local landscape of protein structures with convolutional neural networks
    Anastasiya V. Kulikova
    Daniel J. Diaz
    James M. Loy
    Andrew D. Ellington
    Claus O. Wilke
    Journal of Biological Physics, 2021, 47 : 435 - 454
  • [30] Avoiding local minima in feedforward neural networks by simultaneous learning
    Atakulreka, Akarachai
    Sutivong, Daricha
    AI 2007: ADVANCES IN ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2007, 4830 : 100 - +