A New Supermemory Gradient Method without Line Search for Unconstrained Optimization

被引:0
|
作者
Liu, June [1 ]
Liu, Huanbin [1 ]
Zheng, Yue [1 ]
机构
[1] Huanggang Normal Univ, Inst Uncertain Syst, Coll Math & Informat Sci, Huanggang 438000, Hubei, Peoples R China
关键词
Unconstrained optimization; Memory gradient method; Global convergence; Convergence rate; GLOBAL CONVERGENCE; DESCENT METHODS; FAMILY;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we present a new supermemory gradient method without line search for unconstrained optimization problems. The new method can guarantee a descent at each iteration. It sufficiently uses the previous multi-step iterative information at each iteration and avoids the storage and computation of matrices associated with the Hessian of objective functions, so that it is suitable to solve large scale optimization problems. We also prove its global convergence under some mild conditions. In addition, We analyze the linear convergence rate of the new method when the objective function is uniformly convex and twice continuously differentiable.
引用
收藏
页码:641 / 647
页数:7
相关论文
共 50 条
  • [42] A new variant of the memory gradient method for unconstrained optimization
    Yue Zheng
    Zhongping Wan
    Optimization Letters, 2012, 6 : 1643 - 1655
  • [43] A new variant of the memory gradient method for unconstrained optimization
    Zheng, Yue
    Wan, Zhongping
    OPTIMIZATION LETTERS, 2012, 6 (08) : 1643 - 1655
  • [44] New BFGS method for unconstrained optimization problem based on modified Armijo line search
    Wan, Zhong
    Teo, Kok Lay
    Shen, XianLong
    Hu, ChaoMing
    OPTIMIZATION, 2014, 63 (02) : 285 - 304
  • [45] A nonmonotone line search method and its convergence for unconstrained optimization
    Cui, Zhaocheng
    Yang, Zhenqi
    JOURNAL OF VIBRATION AND CONTROL, 2013, 19 (04) : 517 - 520
  • [46] A TRUNCATED NEWTON METHOD WITH NONMONOTONE LINE SEARCH FOR UNCONSTRAINED OPTIMIZATION
    GRIPPO, L
    LAMPARIELLO, F
    LUCIDI, S
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 1989, 60 (03) : 401 - 419
  • [47] A new conjugate gradient method for solving unconstrained optimization
    Ma, C.-F.
    Xiong, L.-C.
    Changsha Dianli Xueyuan Xuebao/Journal of Changsha University of Electric Power, 2001, 16 (03): : 9 - 11
  • [48] New hybrid conjugate gradient method for unconstrained optimization
    Liu, J.K.
    Li, S.J.
    Applied Mathematics and Computation, 2014, 245 : 36 - 43
  • [49] Convergence of supermemory gradient method
    Shi Z.-J.
    Shen J.
    J. Appl. Math. Comp., 2007, 1-2 (367-376): : 367 - 376
  • [50] A regularized Newton method without line search for unconstrained optimization (vol 59, pg 321, 2014)
    Ueda, Kenji
    Yamashita, Nobuo
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2017, 66 (01) : 219 - 222