AN EFFECTIVE OPTIMIZATION ALGORITHM FOR LOCALLY NONCONVEX LIPSCHITZ FUNCTIONS BASED ON MOLLIFIER SUBGRADIENTS

被引:0
|
作者
Mahdavi-Amiri, N. [1 ]
Yousefpour, R. [2 ]
机构
[1] Sharif Univ Technol, Fac Math Sci, Tehran, Iran
[2] Mazandaran Univ, Fac Math, Babol Sar, Iran
关键词
Locally nonconvex Lipschitz function; mollifier subgradient; Monte-Carlo method; Clarke generalized gradient; dynamic algorithm; NONSMOOTH; POINT;
D O I
暂无
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
We present an effective algorithm for minimization of locally nonconvex Lipschitz functions based on mollifier functions approximating the Clarke generalized gradient. To this aim, first we approximate the Clarke generalized gradient by mollifier subgradients. To construct this approximation, we use a set of averaged functions gradients. Then, we show that the convex hull of this set serves as a good approximation for the Clarke generalized gradient. Using this approximation of the Clarke generalized gradient, we establish an algorithm for minimization of locally Lipschitz functions. Based on mollifier subgradient approximation, we propose a dynamic algorithm for finding a direction satisfying the Armijo condition without needing many subgradient evaluations. We prove that the search direction procedure terminates after finitely many iterations and show how to reduce the objective function value in the obtained search direction. We also prove that the first order optimality conditions are satisfied for any accumulation point of the sequence constructed by the algorithm. Finally, we implement our algorithm with MATLAB codes and approximate averaged functions gradients by the Monte-Carlo method. The numerical results show that our algorithm is effectively more efficient and also more robust than the GS algorithm, currently perceived to be a competitive algorithm for minimization of nonconvex Lipschitz functions.
引用
收藏
页码:171 / 198
页数:28
相关论文
共 50 条
  • [31] WEAK SUBGRADIENT METHOD WITH PATH BASED TARGET LEVEL ALGORITHM FOR NONCONVEX OPTIMIZATION
    Dinc Yalcin, Gulcin
    COMMUNICATIONS FACULTY OF SCIENCES UNIVERSITY OF ANKARA-SERIES A1 MATHEMATICS AND STATISTICS, 2022, 71 (02): : 377 - 394
  • [32] GNSD: A GRADIENT-TRACKING BASED NONCONVEX STOCHASTIC ALGORITHM FOR DECENTRALIZED OPTIMIZATION
    Lu, Songtao
    Zhang, Xinwei
    Sun, Haoran
    Hong, Mingyi
    2019 IEEE DATA SCIENCE WORKSHOP (DSW), 2019, : 315 - 321
  • [33] Effective robust optimization based on genetic algorithm
    Maruyama, Takayuki
    Igarashi, Hajime
    IEEE TRANSACTIONS ON MAGNETICS, 2008, 44 (06) : 990 - 993
  • [34] A deterministic global optimization algorithm based on a linearizing method for nonconvex quadratically constrained programs
    Qu, Shao-Jian
    Ji, Ying
    Zhang, Ke-Cun
    MATHEMATICAL AND COMPUTER MODELLING, 2008, 48 (11-12) : 1737 - 1743
  • [35] NGDE: A Niching-Based Gradient-Directed Evolution Algorithm for Nonconvex Optimization
    Yu, Qi
    Liang, Xijun
    Li, Mengzhen
    Jian, Ling
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, : 1 - 12
  • [36] An effective algorithm for constrained optimization based on optics inspired optimization (OIO)
    Kashan, Ali Husseinzadeh
    COMPUTER-AIDED DESIGN, 2015, 63 : 52 - 71
  • [37] Algorithm for building structures optimization based on Lagrangian functions
    Dmitriev, T. L.
    Ulambayar, Kh
    MAGAZINE OF CIVIL ENGINEERING, 2022, 109 (01):
  • [38] Cloud model based algorithm for global optimization of functions
    School of Computer Science and Technology, Beijing University of Aeronautics and Astronautics, Beijing 100083, China
    不详
    Beijing Hangkong Hangtian Daxue Xuebao, 2007, 4 (486-490):
  • [39] Locally discriminant projection algorithm based on the block optimization and combination strategy
    Zheng J.-W.
    Wang W.-L.
    Yao X.-W.
    Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2011, 33 (09): : 2175 - 2180
  • [40] Adaptive neighbourhood for locally and globally tuned biogeography based optimization algorithm
    Giri, Parimal Kumar
    De, Sagar S.
    Dehuri, Satchidananda
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2021, 33 (04) : 453 - 467