A fast tracking algorithm for generalized LARS/LASSO

被引:20
|
作者
Keerthi, S. Sathiya
Shevade, Shirish
机构
[1] Yahoo Res, Burbank, CA 91504 USA
[2] Indian Inst Sci, Dept Comp Sci & Automat, Bangalore 560012, Karnataka, India
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2007年 / 18卷 / 06期
关键词
generalized Least Angle Regression (LARS); Least Absolute Shrinkage and Selection Operator (LASSO); sparse logistic regression;
D O I
10.1109/TNN.2007.900229
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This letter gives an efficient algorithm for tracking the solution curve of sparse logistic regression With respect to the L I regularization parameter. The algorithm is based on approximating the logistic regression loss by a piecewise quadratic function, using Rosset and Zhu's path tracking algorithm on the approximate problem, and then applying a correction to get to the true path. Application of the algorithm to text classification and sparse kernel logistic regression shows that the algorithm is efficient.
引用
收藏
页码:1826 / 1830
页数:5
相关论文
共 50 条
  • [1] LARS-type algorithm for group lasso
    Chun Yip Yau
    Tsz Shing Hui
    Statistics and Computing, 2017, 27 : 1041 - 1048
  • [2] LARS-type algorithm for group lasso
    Yau, Chun Yip
    Hui, Tsz Shing
    STATISTICS AND COMPUTING, 2017, 27 (04) : 1041 - 1048
  • [3] A FAST ALGORITHM FOR THE BAYESIAN ADAPTIVE LASSO
    Rontogiannis, Athanasios A.
    Themelis, Konstantinos E.
    Koutroumbas, Konstantinos D.
    2012 PROCEEDINGS OF THE 20TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2012, : 974 - 978
  • [4] Autonomous Tracking and State Estimation With Generalized Group Lasso
    Gao, Rui
    Sarkka, Simo
    Claveria-Vega, Ruben
    Godsill, Simon
    IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (11) : 12056 - 12070
  • [5] An Augmented ADMM Algorithm With Application to the Generalized Lasso Problem
    Zhu, Yunzhang
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2017, 26 (01) : 195 - 204
  • [6] Coordinate descent algorithm for generalized group fused Lasso
    Ohishi M.
    Okamura K.
    Itoh Y.
    Wakaki H.
    Yanagihara H.
    Behaviormetrika, 2025, 52 (1) : 105 - 137
  • [7] Efficient Implementations of the Generalized Lasso Dual Path Algorithm
    Arnold, Taylor B.
    Tibshirani, Ryan J.
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2016, 25 (01) : 1 - 27
  • [8] Fast Lasso Algorithm via Selective Coordinate Descent
    Fujiwara, Yasuhiro
    Ida, Yasutoshi
    Shiokawa, Hiroaki
    Iwamura, Sotetsu
    THIRTIETH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2016, : 1561 - 1567
  • [9] The generalized LASSO
    Roth, V
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2004, 15 (01): : 16 - 28
  • [10] A Fast and Scalable Polyatomic Frank-Wolfe Algorithm for the LASSO
    Jarret, Adrian
    Fageot, Julien
    Simeoni, Matthieu
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 637 - 641