Online Learning Based on Online DCA and Application to Online Classification

被引:8
|
作者
Thi, Hoai An Le [1 ]
Ho, Vinh Thanh [1 ]
机构
[1] Univ Lorraine, LGIPM, F-57000 Metz, France
关键词
RELATIVE LOSS BOUNDS; ALGORITHMS; GRADIENT;
D O I
10.1162/neco_a_01266
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We investigate an approach based on DC (Difference of Convex functions) programming and DCA (DC Algorithm) for online learning techniques. The prediction problem of an online learner can be formulated as a DC program for which online DCA is applied. We propose the two so-called complete/approximate versions of online DCA scheme and prove their logarithmic/sublinear regrets. Six online DCA-based algorithms are developed for online binary linear classification. Numerical experiments on a variety of benchmark classification data sets show the efficiency of our proposed algorithms in comparison with the state-of-the-art online classification algorithms.
引用
收藏
页码:759 / 793
页数:35
相关论文
共 50 条
  • [31] ONLINE LEARNING AND APPLICATION OF ACTIVE LEARNING STRATEGIES
    Kuo, Yu-Chun
    BUILDING SUSTAINABLE FUTURES FOR ADULT LEARNERS, 2015, : 157 - 182
  • [32] Online Learning: Concepts, Strategies, and Application
    Koszalka, Tiffany
    AMERICAN JOURNAL OF DISTANCE EDUCATION, 2006, 20 (04) : 249 - 251
  • [33] Application of Online Learning and Classroom Teaching
    Ruan, Bing
    Yang, Minjun
    PROCEEDINGS OF THE 2018 8TH INTERNATIONAL CONFERENCE ON MANAGEMENT, EDUCATION AND INFORMATION (MEICI 2018), 2018, 163 : 1069 - 1073
  • [34] Online learning based Fisher discriminant analysis and its application for fault classification in industrial processes
    Liu, Jun
    Song, Chunyue
    Zhao, Jun
    Ji, Peng
    CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2019, 191 : 30 - 41
  • [35] An Online Learning Approach for Dengue Fever Classification
    Srivastava, Siddharth
    Soman, Sumit
    Rai, Astha
    Cheema, Amarjeet Singh
    2020 IEEE 33RD INTERNATIONAL SYMPOSIUM ON COMPUTER-BASED MEDICAL SYSTEMS(CBMS 2020), 2020, : 163 - 168
  • [36] Online Learning for Classification and Object Tracking with Superpixel
    Chan, Sixian
    Zhou, Xiaolong
    Chen, Shengyong
    2015 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO), 2015, : 1758 - 1763
  • [37] Revised Online Learning with Kernels for Classification and Regression
    Li, Guoqi
    Ning, Ning
    Ramanathan, Kiruthika
    Shi, Luping
    2013 IEEE SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DATA MINING (CIDM), 2013, : 275 - 279
  • [38] On Efficient Online Imitation Learning via Classification
    Li, Yichen
    Zhang, Chicheng
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
  • [39] Online network traffic classification with incremental learning
    Loo, H. R.
    Marsono, M. N.
    EVOLVING SYSTEMS, 2016, 7 (02) : 129 - 143
  • [40] Towards the online learning with Kernels in classification and regression
    Li G.
    Zhao G.
    Yang F.
    Evolving Systems, 2014, 5 (01) : 11 - 19