GLOBAL CONVERGENCE PROPERTIES OF CONJUGATE GRADIENT METHODS FOR OPTIMIZATION

被引:729
|
作者
Gilbert, Jean Charles [1 ]
Nocedal, Jorge [2 ]
机构
[1] Inst Natl Rech Informat & Automat, F-78153 Le Chesnay, France
[2] Northwestern Univ, Dept Elect Engn & Comp Sci, Evanston, IL 60208 USA
基金
美国国家科学基金会; 美国能源部;
关键词
conjugate gradient method; global convergence; unconstrained optimization; large-scale optimization;
D O I
10.1137/0802003
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
This paper explores the convergence of nonlinear conjugate gradient methods without restarts, and with practical line searches. The analysis covers two classes of methods that are globally convergent on smooth, nonconvex functions. Some properties of the Fletcher-Reeves method play an important role in the first family, whereas the second family shares an important property with the Polak-Ribiere method. Numerical experiments are presented.
引用
收藏
页码:21 / 42
页数:22
相关论文
共 50 条
  • [1] Global Convergence Property of Conjugate Gradient Methods for Optimization
    LIAN Shu\|jun Institute of Operations Research
    Journal of Systems Science and Systems Engineering, 1999, (03) : 277 - 282
  • [2] Hybrid Riemannian conjugate gradient methods with global convergence properties
    Sakai, Hiroyuki
    Iiduka, Hideaki
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2020, 77 (03) : 811 - 830
  • [3] Hybrid Riemannian conjugate gradient methods with global convergence properties
    Hiroyuki Sakai
    Hideaki Iiduka
    Computational Optimization and Applications, 2020, 77 : 811 - 830
  • [4] Global convergence of a family of conjugate gradient methods
    Yu, Hongxia
    Du, Xuewu
    Gongcheng Shuxue Xuebao/Chinese Journal of Engineering Mathematics, 1998, 15 (03): : 69 - 73
  • [5] Global Convergence Properties of Conjugate Gradient Methods for Optimal Control Problems
    Chen Xuesong
    Cai Shuting
    PROCEEDINGS OF THE 35TH CHINESE CONTROL CONFERENCE 2016, 2016, : 2542 - 2547
  • [6] Two modified spectral conjugate gradient methods and their global convergence for unconstrained optimization
    Sun, Zhongbo
    Li, Hongyang
    Wang, Jing
    Tian, Yantao
    INTERNATIONAL JOURNAL OF COMPUTER MATHEMATICS, 2018, 95 (10) : 2082 - 2099
  • [7] Two Modified PRP Conjugate Gradient Methods and Their Global Convergence for Unconstrained Optimization
    Sun Zhongbo
    Cao Xue
    Guo Yingying
    Ge Yuncheng
    Sun Yue
    2017 29TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2017, : 7896 - 790
  • [8] The Global Convergence Properties of a Conjugate Gradient Method
    Omer, Osman
    Mamat, Mustafa
    Abashar, Abdelrhaman
    Rivaie, Mohd
    PROCEEDINGS OF THE 3RD INTERNATIONAL CONFERENCE ON MATHEMATICAL SCIENCES, 2014, 1602 : 286 - 295
  • [9] Convergence properties of nonlinear conjugate gradient methods
    Dai, YH
    Han, JY
    Liu, GH
    Sun, DF
    Yin, HX
    Yuan, YX
    SIAM JOURNAL ON OPTIMIZATION, 2000, 10 (02) : 345 - 358
  • [10] GLOBAL CONVERGENCE RESULT FOR CONJUGATE-GRADIENT METHODS
    HU, YF
    STOREY, C
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 1991, 71 (02) : 399 - 405