QUASI-NEWTON METHODS FOR MULTIOBJECTIVE OPTIMIZATION PROBLEMS: A SYSTEMATIC REVIEW

被引:0
|
作者
Kumar K. [1 ]
Ghosh D. [1 ]
Upadhayay A. [1 ,2 ]
Yao J.C. [3 ]
Zhao X. [4 ]
机构
[1] Department of Mathematics, Indian Institute of Technology (BHU), Uttar Pradesh, Varanasi
[2] Department of Mathematics, Bareilly College, Uttar Pradesh, Bareilly
[3] Centre for General Education, China Medical University, Taichung
[4] School of Mathematical Sciences, Tiangong University, Tianjin
来源
基金
中国国家自然科学基金;
关键词
BFGS; H-BFGS; Multiobjective optimization; Performance profiles; Quasi-Newton method; SS-BFGS;
D O I
10.23952/asvao.5.2023.2.12
中图分类号
学科分类号
摘要
Quasi-Newton method is one of the most popular methods for solving unconstrained single and multiobjective optimization problems. In a quasi-Newton method, the search direction is computed based on a quadratic model of the objective function, where some approximations replace the true Hessian at each iteration. Several Hessian approximation schemes with an adequate line search technique provided higher-order accuracies in approximating the curvature and made the methods more effective in terms of convergence to solution. Considering the aforementioned reasons, we write a survey on quasi-Newton methods for multiobjective optimization problems. We discuss the development of all the variants of the quasi-Newton method for multiobjective optimization problems, along with some of the advantages and disadvantages of the existing methods. We give a brief discussion about the line search for these variants too. Two cases have been considered for BFGS, Huang BFGS, and self-scaling BFGS multiobjective versions of quasi-Newton methods: one is in the presence of the Armijo line search, and the other is in the absence of any line search. Subsequently, a nonmonotone line search version is also explained for multiobjective optimization problems. Commentary is given on the convergence properties of these methods. The rate of convergence of all these methods is highlighted. To prove the convergence of every method, it is reported that every sequence of points generated from the method converges to a critical point of the multiobjective optimization problem under some mild assumptions. Based on the available numerical data, we provide an unbiased opinion on the effectiveness of quasi-Newton methods for multiobjective optimization problems. © 2023 Authors. All rights reserved.
引用
收藏
页码:291 / 321
页数:30
相关论文
共 50 条
  • [41] QUASI-NEWTON METHODS WITH APPROXIMATE SOLUTION OF AUXILIARY PROBLEMS
    DANILIN, YM
    MORAR, VA
    CYBERNETICS, 1981, 17 (01): : 8 - 11
  • [42] IMPROVED QUASI-NEWTON METHODS FOR LARGE NONLINEAR PROBLEMS
    PAPADRAKAKIS, M
    BALOPOULOS, V
    JOURNAL OF ENGINEERING MECHANICS-ASCE, 1991, 117 (06): : 1201 - 1219
  • [43] Global convergence of quasi-Newton methods for unconstrained optimization
    Han, LX
    Liu, GH
    CHINESE SCIENCE BULLETIN, 1996, 41 (07): : 529 - 533
  • [44] STRUCTURED QUASI-NEWTON METHODS FOR OPTIMIZATION WITH ORTHOGONALITY CONSTRAINTS
    Hu, Jiang
    Jiang, Bo
    Lin, Lin
    Wen, Zaiwen
    Yuan, Ya-Xiang
    SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2019, 41 (04): : A2239 - A2269
  • [45] Approximate invariant subspaces and quasi-newton optimization methods
    Gratton, Serge
    Toint, Philippe L.
    OPTIMIZATION METHODS & SOFTWARE, 2010, 25 (04): : 507 - 529
  • [46] Proximal quasi-Newton methods for nondifferentiable convex optimization
    Chen, XJ
    Fukushima, M
    MATHEMATICAL PROGRAMMING, 1999, 85 (02) : 313 - 334
  • [47] A BROYDEN CLASS OF QUASI-NEWTON METHODS FOR RIEMANNIAN OPTIMIZATION
    Huang, Wen
    Gallivan, K. A.
    Absil, P. -A.
    SIAM JOURNAL ON OPTIMIZATION, 2015, 25 (03) : 1660 - 1685
  • [48] COMBINED LP AND QUASI-NEWTON METHODS FOR MINIMAX OPTIMIZATION
    HALD, J
    MADSEN, K
    MATHEMATICAL PROGRAMMING, 1981, 20 (01) : 49 - 62
  • [49] IMPROVED DAMPED QUASI-NEWTON METHODS FOR UNCONSTRAINED OPTIMIZATION
    Al-Baali, M.
    Grandinetti, L.
    PACIFIC JOURNAL OF OPTIMIZATION, 2019, 15 (01): : 45 - 54
  • [50] Proximal quasi-Newton methods for nondifferentiable convex optimization
    Xiaojun Chen
    Masao Fukushima
    Mathematical Programming, 1999, 85 : 313 - 334