A Smooth Method for Solving Non-Smooth Unconstrained Optimization Problems

被引:0
|
作者
Rahmanpour, F. [1 ]
Hosseini, M. M. [1 ]
机构
[1] Yazd Univ, Dept Math, Math, Yazd, Iran
关键词
Derivative-free; trust-region method; non smooth optimization; unconstrained optimization problems; radial basis functions;
D O I
暂无
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
We consider unconstrained optimization problems using the expensive objective function in which the derivatives are not available. This property of problems can often impede the performance of optimization algorithms. Most algorithms usually determine a Quasi-Newton direction and then use line search technique. We propose a smoothing algorithm which is developed to modify trust region and to handle the objective function based on radial basis functions (RBFs). The value of objective function is reduced according to the relation with the predicted reduction of surrogate model. At each iteration we construct the quadratic model based on RBFs. The global convergence of the proposed method is studied. The numerical results are presented for some standard test problem to validate the theoretical results.
引用
收藏
页码:11 / 33
页数:23
相关论文
共 50 条
  • [41] A Newton-like method for solving a non-smooth elliptic equation
    Zeng, Jinping
    Yu, Haixiong
    OPTIMIZATION METHODS & SOFTWARE, 2013, 28 (04): : 917 - 929
  • [42] An efficient primal dual prox method for non-smooth optimization
    Tianbao Yang
    Mehrdad Mahdavi
    Rong Jin
    Shenghuo Zhu
    Machine Learning, 2015, 98 : 369 - 406
  • [43] An efficient primal dual prox method for non-smooth optimization
    Yang, Tianbao
    Mahdavi, Mehrdad
    Jin, Rong
    Zhu, Shenghuo
    MACHINE LEARNING, 2015, 98 (03) : 369 - 406
  • [44] Convergence guarantees for a class of non-convex and non-smooth optimization problems
    Khamaru, Koulik
    Wainwright, Martin J.
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [45] Convergence guarantees for a class of non-convex and non-smooth optimization problems
    Khamaru, Koulik
    Wainwright, Martin J.
    Journal of Machine Learning Research, 2019, 20
  • [46] STOCHASTIC METHODS OF SOLVING NON-SMOOTH EXTREMAL PROBLEMS - RUSSIAN - GUPAL,AM
    PICEK, K
    EKONOMICKO-MATEMATICKY OBZOR, 1980, 16 (03): : 356 - 356
  • [47] Convergence guarantees for a class of non-convex and non-smooth optimization problems
    Khamaru, Koulik
    Wainwright, Martin J.
    JOURNAL OF MACHINE LEARNING RESEARCH, 2019, 20
  • [48] Adaptive monotone multigrid methods for some non-smooth optimization problems
    Kornhuber, R
    DOMAIN DECOMPOSITION METHODS IN SCIENCES AND ENGINEERING, 1997, : 177 - 191
  • [49] Continuous Dynamics Related to Monotone Inclusions and Non-Smooth Optimization Problems
    Ernö Robert Csetnek
    Set-Valued and Variational Analysis, 2020, 28 : 611 - 642
  • [50] Mirror Descent and Convex Optimization Problems with Non-smooth Inequality Constraints
    Bayandina, Anastasia
    Dvurechensky, Pavel
    Gasnikov, Alexander
    Stonyakin, Fedor
    Titov, Alexander
    LARGE-SCALE AND DISTRIBUTED OPTIMIZATION, 2018, 2227 : 181 - 213