Accelerating gradient method based on the vector extrapolation of Aitken-process

被引:0
|
作者
Li, Jianliang [1 ]
Jiang, Yong [1 ]
Zhu, Hua [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Sci, Nanjing 210094, Peoples R China
关键词
optimization; gradient method; Aitken-process; extrapolation method; vector sequence;
D O I
暂无
中图分类号
C93 [管理学];
学科分类号
12 ; 1201 ; 1202 ; 120202 ;
摘要
This study, we adopt an accelerating gradient method based on the vector extrapolation of Aitken-Process. It is also concluded that the algorithm is not only convergent but accelerated. The numerical results show that almost half of the CPU time may be economized. If the problem is complex, even 98% of the CPU time can be saved. Finally, we use the accelerating gradient method to the learning process of the feedforward multilayer neural network.
引用
收藏
页码:325 / 330
页数:6
相关论文
共 50 条
  • [1] Vector Aitken extrapolation method for multilinear PageRank computations
    Maryam Boubekraoui
    Abdeslem Hafid Bentbib
    Khalide Jbilou
    Journal of Applied Mathematics and Computing, 2023, 69 : 1145 - 1172
  • [2] Vector Aitken extrapolation method for multilinear PageRank computations
    Boubekraoui, Maryam
    Bentbib, Abdeslem Hafid
    Jbilou, Khalide
    JOURNAL OF APPLIED MATHEMATICS AND COMPUTING, 2023, 69 (01) : 1145 - 1172
  • [3] Generalizations of Aitken's process for accelerating the convergence of sequences
    Brezinski, Claude
    Zaglia, Michela Redivo
    COMPUTATIONAL & APPLIED MATHEMATICS, 2007, 26 (02): : 171 - 189
  • [4] Generalizations of Aitken's process for accelerating the convergence of sequences
    Brezinski, Claude
    Zaglia, Michela Redivo
    Computational and Applied Mathematics, 2007, 26 (02) : 171 - 189
  • [5] A new Aitken type method for accelerating iterative sequences
    Bumbariu, Oana
    APPLIED MATHEMATICS AND COMPUTATION, 2012, 219 (01) : 78 - 82
  • [6] An improved Aitken extrapolation in hyperlink-based ranking
    Liu, Huiyi
    Dong, Zhiyong
    DYNAMICS OF CONTINUOUS DISCRETE AND IMPULSIVE SYSTEMS-SERIES B-APPLICATIONS & ALGORITHMS, 2006, 13E : 2633 - 2636
  • [7] Aitken extrapolation method for computing the largest eigenvalue of nonnegative tensors
    Yin, Jun-Feng
    Kong, Xiao-He
    Zheng, Ning
    APPLIED MATHEMATICS AND COMPUTATION, 2015, 258 : 350 - 357
  • [8] Addition to the Aitken method for the extrapolation of the limit of slowly convergent sequences
    V. N. Bakulin
    V. Inflianskas
    Computational Mathematics and Mathematical Physics, 2016, 56 : 191 - 199
  • [9] Addition to the Aitken method for the extrapolation of the limit of slowly convergent sequences
    Bakulin, V. N.
    Inflianskas, V.
    COMPUTATIONAL MATHEMATICS AND MATHEMATICAL PHYSICS, 2016, 56 (02) : 191 - 199
  • [10] Accelerating the convergence of a tokamak modeling code with Aitken's method
    Haelterman, R.
    Van Eester, D.
    COMPUTER PHYSICS COMMUNICATIONS, 2015, 196 : 70 - 79