Large-scale regression with non-convex loss and penalty

被引:16
|
作者
Buccini, Alessandro [1 ]
Cabrera, Omar De la Cruz [2 ]
Donatelli, Marco [3 ]
Martinelli, Andrea [3 ]
Reichel, Lothar [2 ]
机构
[1] Univ Cagliari, Dept Math & Comp Sci, I-09124 Cagliari, Italy
[2] Kent State Univ, Dept Math Sci, Kent, OH 44242 USA
[3] Univ Insubria, Dept Sci & High Technol, I-22100 Como, Italy
关键词
Regression; Regularization; Robustness; Non-convex Optimization; MINIMIZATION; REGULARIZATION; SHRINKAGE; ALGORITHM; SPARSITY;
D O I
10.1016/j.apnum.2020.07.006
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We describe a computational method for parameter estimation in linear regression, that is capable of simultaneously producing sparse estimates and dealing with outliers and heavy-tailed error distributions. The method used is based on the image restoration method proposed in Huang et al. (2017) [13]. It can be applied to problems of arbitrary size. The choice of certain parameters is discussed. Results obtained for simulated and real data are presented. (C) 2020 IMACS. Published by Elsevier B.V. All rights reserved.
引用
收藏
页码:590 / 601
页数:12
相关论文
共 50 条
  • [21] Beam Orientation Optimization with Non-Convex Group Sparsity Penalty
    O'Connor, D.
    Nguyen, D.
    Ruan, D.
    Yu, V.
    Sheng, K.
    MEDICAL PHYSICS, 2017, 44 (06) : 3225 - 3225
  • [22] A new hybrid conjugate gradient method for large-scale unconstrained optimization problem with non-convex objective function
    Zahra Khoshgam
    Ali Ashrafi
    Computational and Applied Mathematics, 2019, 38
  • [23] A new modified scaled conjugate gradient method for large-scale unconstrained optimization with non-convex objective function
    Khoshgam, Zahra
    Ashrafi, Ali
    OPTIMIZATION METHODS & SOFTWARE, 2019, 34 (04): : 783 - 796
  • [24] Improved Fireworks Algorithm with Chaotic Sequence Operator for Large-Scale Non-convex Economic Load Dispatch Problem
    Vipin Chandra Pandey
    Vinay Kumar Jadoun
    Nikhil Gupta
    K. R. Niazi
    Anil Swarnkar
    Arabian Journal for Science and Engineering, 2018, 43 : 2919 - 2929
  • [25] Compressed sensing of large-scale local field potentials using adaptive sparsity analysis and non-convex optimization
    Sun, Biao
    Zhang, Han
    Zhang, Yunyan
    Wu, Zexu
    Bao, Botao
    Hu, Yong
    Li, Ting
    JOURNAL OF NEURAL ENGINEERING, 2021, 18 (02)
  • [26] Improved Fireworks Algorithm with Chaotic Sequence Operator for Large-Scale Non-convex Economic Load Dispatch Problem
    Pandey, Vipin Chandra
    Jadoun, Vinay Kumar
    Gupta, Nikhil
    Niazi, K. R.
    Swarnkar, Anil
    ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2018, 43 (06) : 2919 - 2929
  • [27] A new hybrid conjugate gradient method for large-scale unconstrained optimization problem with non-convex objective function
    Khoshgam, Zahra
    Ashrafi, Ali
    COMPUTATIONAL & APPLIED MATHEMATICS, 2019, 38 (04):
  • [28] Large Scale Image Understanding with Non-convex Multi-task Learning
    Li, Liang
    Yan, Chenggang
    Chen, Xing
    Jiang, Shuqiang
    Rho, Seungmin
    Yin, Jian
    Jiang, Baochen
    Huang, Qingming
    2014 5TH INTERNATIONAL CONFERENCE ON GAME THEORY FOR NETWORKS (GAMENETS), 2014,
  • [29] No Internal Regret with Non-convex Loss Functions
    Sharma, Dravyansh
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 13, 2024, : 14919 - 14927
  • [30] Penalty boundary sequential convex programming algorithm for non-convex optimal control problems
    Zhang, Zhe
    Jin, Gumin
    Li, Jianxun
    ISA TRANSACTIONS, 2018, 72 : 229 - 244