Chance-Constrained Abnormal Data Cleaning for Robust Classification With Noisy Labels

被引:1
|
作者
Shen, Xun [1 ]
Luo, Zhaojie [2 ]
Li, Yuanchao [3 ]
Ouyang, Tinghui [4 ]
Wu, Yuhu [5 ]
机构
[1] Osaka Univ, Grad Sch Engn, Osaka 5650871, Japan
[2] Southeast Univ, Sch Biol Sci & Med Engn, Nanjing 210096, Peoples R China
[3] Univ Edinburgh, Inst Language Cognit & Computat, Edinburgh EH8 9YL, Scotland
[4] Natl Inst Adv Ind Sci & Technol, Tokyo 1350064, Japan
[5] Dalian Univ Technol, Sch Control Sci & Engn, Dalian 116024, Peoples R China
关键词
Classification with noisy labels; chance constrained optimization; APPROXIMATION; OPTIMIZATION;
D O I
10.1109/TETCI.2024.3375518
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Supervised classification is a common field of machine learning. However, the existing classification methods based on deep models are vulnerable to overfitting the noisy labels in the training set. This paper proposes a data-cleaning method to achieve robust classification against noisy labels. A chance-constrained abnormal data cleaning approach is proposed based on chance-constrained optimization, in which a polynomial sublevel set for the data of each class is generated. The data outside the polynomial sublevel set is abnormal and has a low probability of belonging to the labeled class. The classification method only uses normal data to establish the estimated classifiers. We show the convergence of the proposed abnormal data-cleaning approach. Furthermore, we give the algorithm for classification with abnormal data cleaning. Experimental data-based validations have been implemented to validate the proposed classification algorithm. The results show that the proposed approach can correctly clean the abnormal noisy labels and improve the performance of Supervised classification methods.
引用
收藏
页码:1 / 8
页数:8
相关论文
共 50 条
  • [41] A distributionally robust chance-constrained model for humanitarian relief network design
    Jiang, Zhenlong
    Ji, Ran
    Dong, Zhijie Sasha
    OR SPECTRUM, 2023, 45 (04) : 1153 - 1195
  • [42] Robust Chance-Constrained Geometric Programming with Application to Demand Risk Mitigation
    Belleh Fontem
    Journal of Optimization Theory and Applications, 2023, 197 : 765 - 797
  • [43] Robust Classification of Incomplete Time Series with Noisy Labels
    Qin, Xin
    Yao, Pengshuai
    Liu, Mengna
    Cheng, Xu
    Shi, Fan
    Guo, Lili
    PROCEEDINGS OF THE 2024 27 TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, CSCWD 2024, 2024, : 2620 - 2625
  • [44] Distributionally Robust Chance-constrained Program Surgery Planning with Downstream Resource
    Wang, Shanshan
    Li, Jinlin
    Peng, Chun
    2017 14TH INTERNATIONAL CONFERENCE ON SERVICES SYSTEMS AND SERVICES MANAGEMENT (ICSSSM), 2017,
  • [45] Distributionally robust chance-constrained optimization with Gaussian mixture ambiguity set
    Kammammettu, Sanjula
    Yang, Shu-Bo
    Li, Zukui
    COMPUTERS & CHEMICAL ENGINEERING, 2024, 186
  • [46] Chance-Constrained Robust Beamforming for Multi-Cell Coordinated Downlink
    Shen, Chao
    Chang, Tsung-Hui
    Wang, Kun-Yu
    Qiu, Zhengding
    Chi, Chong-Yung
    2012 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2012, : 4957 - 4962
  • [47] Scheduling of Energy Hub Resources Using Robust Chance-Constrained Optimization
    Esmaeel Nezhad, Ali
    Nardelli, Pedro H. J.
    Sahoo, Subham
    Ghanavati, Farideh
    IEEE ACCESS, 2022, 10 : 129738 - 129753
  • [48] DISTRIBUTIONALLY ROBUST CHANCE-CONSTRAINED TRANSMIT BEAMFORMING FOR MULTIUSER MISO DOWNLINK
    Li, Qiang
    So, Anthony Man-Cho
    Ma, Wing-Kin
    2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
  • [49] Approximating the chance-constrained capacitated vehicle routing problem with robust optimization
    Karina Thiebaut
    Artur Pessoa
    4OR, 2023, 21 : 513 - 531
  • [50] Managing Data Quality of the Data Warehouse: A Chance-Constrained Programming Approach
    Qi Liu
    Gengzhong Feng
    Giri Kumar Tayi
    Jun Tian
    Information Systems Frontiers, 2021, 23 : 375 - 389