Efficient Meta label correction based on Meta Learning and bi-level optimization

被引:7
|
作者
Mallem, Soufiane [1 ,2 ]
Hasnat, Abul [2 ]
Nakib, Amir [2 ]
机构
[1] TCHEK, Marseille, France
[2] Univ Paris Est Creteil, Lab LISSI, Vitry Sur Seine, France
关键词
Deep learning; Bi-level optimization; Meta Learning; Image classification;
D O I
10.1016/j.engappai.2022.105517
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The design of highly accurate deep learning architectures is related to different parameters through different optimizations at different levels of the design. While the architectural design and the training procedure of the neural networks play significant role, the quantity and the quality of the available data remain also very important issues. This research aims to address the quality of the data issue: the data contain imprecise or noisy labels. Numerous approaches have been proposed in the literature to leverage noisy data in case of different noisy labels as well as the strategies and frameworks developed to use the data in practice. Recently, meta-learning based methods have shown good performance to optimize models that take into account the presence of noisy labels within the training dataset. In this work, we propose a new method called Meta label correction via Meta Learning and bi-level optimization (CO-META). It is based on extracting and providing only relevant features to enhance the performance of the label corrector network to tackle the raised problem. The obtained results demonstrate that the proposed method outperforms the state-of-the-art accuracy on the well-known image classification datasets.
引用
收藏
页数:8
相关论文
共 50 条
  • [41] Feature construction as a bi-level optimization problem
    Marwa Hammami
    Slim Bechikh
    Ali Louati
    Mohamed Makhlouf
    Lamjed Ben Said
    Neural Computing and Applications, 2020, 32 : 13783 - 13804
  • [42] Feature construction as a bi-level optimization problem
    Hammami, Marwa
    Bechikh, Slim
    Louati, Ali
    Makhlouf, Mohamed
    Ben Said, Lamjed
    NEURAL COMPUTING & APPLICATIONS, 2020, 32 (17): : 13783 - 13804
  • [43] Model building using bi-level optimization
    Saharidis, G. K. D.
    Androulakis, I. P.
    Ierapetritou, M. G.
    JOURNAL OF GLOBAL OPTIMIZATION, 2011, 49 (01) : 49 - 67
  • [44] A novel bi-level meta-analysis approach: applied to biological pathway analysis
    Nguyen, Tin
    Tagett, Rebecca
    Donato, Michele
    Mitrea, Cristina
    Draghici, Sorin
    BIOINFORMATICS, 2016, 32 (03) : 409 - 416
  • [45] An automated bi-level optimization approach for IMRT
    Carrasqueira, P.
    Alves, M. J.
    Dias, J. M.
    Rocha, H.
    Ventura, T.
    Ferreira, B. C.
    Lopes, M. C.
    INTERNATIONAL TRANSACTIONS IN OPERATIONAL RESEARCH, 2023, 30 (01) : 224 - 238
  • [46] Bi-level optimization for a dynamic multiobjective problem
    Linnala, Mikko
    Madetoja, Elina
    Ruotsalainen, Henri
    Hamalainen, Jari
    ENGINEERING OPTIMIZATION, 2012, 44 (02) : 195 - 207
  • [47] Bi-level programming based contra flow optimization for evacuation events
    Lv, Nengchao
    Yan, Xinping
    Xu, Kun
    Wu, Chaozhong
    KYBERNETES, 2010, 39 (08) : 1227 - 1234
  • [48] Value-Function-Based Sequential Minimization for Bi-Level Optimization
    Liu, Risheng
    Liu, Xuan
    Zeng, Shangzhi
    Zhang, Jin
    Zhang, Yixuan
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (12) : 15930 - 15948
  • [49] Line overload control strategy based on bi-level optimization programming
    Ke Y.
    Liao K.
    Li B.
    Yang J.
    He Z.
    Dianli Zidonghua Shebei/Electric Power Automation Equipment, 2021, 41 (12): : 158 - 165
  • [50] Structural optimization of body-in-white based on bi-level programming
    Gao, Yunkai
    Wang, Jingren
    Fang, Jianguang
    Wang, Yuan
    Wang, J. (jingrenw@126.com), 1600, Chinese Mechanical Engineering Society (48): : 98 - 104