Neurodynamic Algorithms With Finite/Fixed-Time Convergence for Sparse Optimization via l1 Regularization

被引:6
|
作者
Wen, Hongsong [1 ]
He, Xing [1 ]
Huang, Tingwen [2 ]
Yu, Junzhi [3 ,4 ]
机构
[1] Southwest Univ, Coll Elect & Informat Engn, Chongqing Key Lab Nonlinear Circuits & Intelligent, Chongqing 400715, Peoples R China
[2] Texas A&M Univ Qatar, Dept Math, Doha, Qatar
[3] Peking Univ, Coll Engn, Dept Adv Mfg & Robot, State Key Lab Turbulence & Complex Syst, Beijing 100871, Peoples R China
[4] Peking Univ, Nanchang Innovat Inst, Nanchang 330224, Peoples R China
关键词
l(1) regularization; finite-time stability (FTS); fixed-time stability (FxTS); locally competitive algorithm (LCA); sparse optimization; SIGNAL RECONSTRUCTION; RECOVERY; PROJECTION;
D O I
10.1109/TSMC.2023.3304850
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Sparse optimization problems have been successfully applied to a wide range of research areas, and useful insights and elegant methods for proving the stability and convergence of neurodynamic algorithms have been yielded in previous work. This article develops several neurodynamic algorithms for sparse signal recovery by solving the l(1) regularization problem. First, in the framework of the locally competitive algorithm (LCA), modified LCA (MLCA) with finite-time convergence and MLCA with fixed-time convergence are designed. Then, the sliding-mode control (SMC) technique is introduced and modified, i.e., modified SMC (MSMC), which is combined with LCA to design MSMC-LCA with finite-time convergence and MSMC-LCA with fixed-time convergence. It is shown that the solutions of the proposed neurodynamic algorithms exist and are unique under the observation matrix satisfying restricted isometry property (RIP) condition, while finite-time or fixed-time convergence to the optimal points is shown via Lyapunov-based analysis. In addition, combining the notions of finite-time stability (FTS) and fixed-time stability (FxTS), upper bounds on the convergence time of the proposed neurodynamic algorithms are given, and the convergence results obtained for the MLCA and MSMC-LCA with fixed-time convergence are shown to be independent of the initial conditions. Finally, simulation experiments of signal recovery and image recovery are carried out to demonstrate the superior performance of the proposed neurodynamic algorithms.
引用
收藏
页码:131 / 142
页数:12
相关论文
共 50 条
  • [31] Fixed-time neurodynamic optimization approach with time-varying coefficients to variational inequality problems and applications
    Ju, Xingxing
    Yang, Xinsong
    Yuan, Shuang
    Ho, Daniel W. C.
    COMMUNICATIONS IN NONLINEAR SCIENCE AND NUMERICAL SIMULATION, 2025, 140
  • [32] A neurodynamic approach with fixed-time convergence for complex-variable pseudo-monotone variational inequalities
    Zheng, Jinlan
    Ju, Xingxing
    Zhang, Naimin
    Xu, Dongpo
    NEUROCOMPUTING, 2025, 617
  • [33] Iteratively Reweighted l1 Approaches to Sparse Composite Regularization
    Ahmad, Rizwan
    Schniter, Philip
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2015, 1 (04) : 220 - 235
  • [34] Sparse Auto-encoder with Smoothed l1 Regularization
    Zhang, Li
    Lu, Yaping
    Zhang, Zhao
    Wang, Bangjun
    Li, Fanzhang
    NEURAL INFORMATION PROCESSING, ICONIP 2016, PT III, 2016, 9949 : 555 - 563
  • [35] Sparse SAR imaging based on L1/2 regularization
    ZENG JinShan
    Science China(Information Sciences), 2012, 55 (08) : 1755 - 1775
  • [36] Sparse SAR imaging based on L1/2 regularization
    JinShan Zeng
    Jian Fang
    ZongBen Xu
    Science China Information Sciences, 2012, 55 : 1755 - 1775
  • [37] NONCONVEX L1/2 REGULARIZATION FOR SPARSE PORTFOLIO SELECTION
    Xu, Fengmin
    Wang, Guan
    Gao, Yuelin
    PACIFIC JOURNAL OF OPTIMIZATION, 2014, 10 (01): : 163 - 176
  • [38] Make l1 regularization effective in training sparse CNN
    He, Juncai
    Jia, Xiaodong
    Xu, Jinchao
    Zhang, Lian
    Zhao, Liang
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2020, 77 (01) : 163 - 182
  • [39] Distributed Algorithm for Time-varying Convex Optimization with Fixed-time Convergence
    Shen, Yuanchu
    Chen, Chen
    Zeng, Xianlin
    Chen, Wenjie
    2024 IEEE 18TH INTERNATIONAL CONFERENCE ON CONTROL & AUTOMATION, ICCA 2024, 2024, : 314 - 318
  • [40] Sparse spatial filter via a novel objective function minimization with smooth l1 regularization
    Onaran, Ibrahim
    Ince, N. Firat
    Cetin, A. Enis
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2013, 8 (03) : 282 - 288