Large-scale regression with non-convex loss and penalty

被引:16
|
作者
Buccini, Alessandro [1 ]
Cabrera, Omar De la Cruz [2 ]
Donatelli, Marco [3 ]
Martinelli, Andrea [3 ]
Reichel, Lothar [2 ]
机构
[1] Univ Cagliari, Dept Math & Comp Sci, I-09124 Cagliari, Italy
[2] Kent State Univ, Dept Math Sci, Kent, OH 44242 USA
[3] Univ Insubria, Dept Sci & High Technol, I-22100 Como, Italy
关键词
Regression; Regularization; Robustness; Non-convex Optimization; MINIMIZATION; REGULARIZATION; SHRINKAGE; ALGORITHM; SPARSITY;
D O I
10.1016/j.apnum.2020.07.006
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We describe a computational method for parameter estimation in linear regression, that is capable of simultaneously producing sparse estimates and dealing with outliers and heavy-tailed error distributions. The method used is based on the image restoration method proposed in Huang et al. (2017) [13]. It can be applied to problems of arbitrary size. The choice of certain parameters is discussed. Results obtained for simulated and real data are presented. (C) 2020 IMACS. Published by Elsevier B.V. All rights reserved.
引用
收藏
页码:590 / 601
页数:12
相关论文
共 50 条
  • [1] Numerical methods for large-scale non-convex quadratic programming
    Gould, NIM
    Toint, PL
    TRENDS IN INDUSTRIAL AND APPLIED MATHEMATICS, PROCEEDINGS, 2002, 72 : 149 - 179
  • [2] On the softplus penalty for large-scale convex optimization
    Li, Meng
    Grigas, Paul
    Atamturk, Alper
    OPERATIONS RESEARCH LETTERS, 2023, 51 (06) : 666 - 672
  • [3] Large-Scale Non-convex Stochastic Constrained Distributionally Robust Optimization
    Zhang, Qi
    Zhou, Yi
    Prater-Bennette, Ashley
    Shen, Lixin
    Zou, Shaofeng
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 8, 2024, : 8217 - 8225
  • [4] A reduced proximal-point homotopy method for large-scale non-convex BQP
    Xiubo Liang
    Guoqiang Wang
    Bo Yu
    Computational Optimization and Applications, 2022, 81 : 539 - 567
  • [5] Non-Convex Large-Scale Scheduling for Energy-Efficient Flexible Stamping Systems
    Pang, Chee Khiang
    Cao Vinh Le
    2013 10TH IEEE INTERNATIONAL CONFERENCE ON CONTROL AND AUTOMATION (ICCA), 2013, : 1656 - 1661
  • [6] A reduced proximal-point homotopy method for large-scale non-convex BQP
    Liang, Xiubo
    Wang, Guoqiang
    Yu, Bo
    COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2022, 81 (02) : 539 - 567
  • [7] A non-convex optimization framework for large-scale low-rank matrix factorization
    Hafshejani, Sajad Fathi
    Vahidian, Saeed
    Moaberfard, Zahra
    Lin, Bill
    MACHINE LEARNING WITH APPLICATIONS, 2022, 10
  • [8] Feature screening strategy for non-convex sparse logistic regression with log sum penalty
    Yuan, Min
    Xu, Yitian
    INFORMATION SCIENCES, 2023, 624 : 732 - 747
  • [9] Robust non-convex least squares loss function for regression with outliers
    Wang, Kuaini
    Zhong, Ping
    KNOWLEDGE-BASED SYSTEMS, 2014, 71 : 290 - 302
  • [10] Stochastic variance reduced gradient with hyper-gradient for non-convex large-scale learning
    Yang, Zhuang
    APPLIED INTELLIGENCE, 2023, 53 (23) : 28627 - 28641