Efficient Meta label correction based on Meta Learning and bi-level optimization

被引:7
|
作者
Mallem, Soufiane [1 ,2 ]
Hasnat, Abul [2 ]
Nakib, Amir [2 ]
机构
[1] TCHEK, Marseille, France
[2] Univ Paris Est Creteil, Lab LISSI, Vitry Sur Seine, France
关键词
Deep learning; Bi-level optimization; Meta Learning; Image classification;
D O I
10.1016/j.engappai.2022.105517
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The design of highly accurate deep learning architectures is related to different parameters through different optimizations at different levels of the design. While the architectural design and the training procedure of the neural networks play significant role, the quantity and the quality of the available data remain also very important issues. This research aims to address the quality of the data issue: the data contain imprecise or noisy labels. Numerous approaches have been proposed in the literature to leverage noisy data in case of different noisy labels as well as the strategies and frameworks developed to use the data in practice. Recently, meta-learning based methods have shown good performance to optimize models that take into account the presence of noisy labels within the training dataset. In this work, we propose a new method called Meta label correction via Meta Learning and bi-level optimization (CO-META). It is based on extracting and providing only relevant features to enhance the performance of the label corrector network to tackle the raised problem. The obtained results demonstrate that the proposed method outperforms the state-of-the-art accuracy on the well-known image classification datasets.
引用
收藏
页数:8
相关论文
共 50 条
  • [21] Evolutionary multitasking in bi-level optimization
    Gupta, Abhishek
    Mandziuk, Jacek
    Ong, Yew-Soon
    COMPLEX & INTELLIGENT SYSTEMS, 2015, 1 (1-4) : 83 - 95
  • [22] A bi-level optimization for an HVAC system
    Luping Zhuang
    Xi Chen
    Xiaohong Guan
    Cluster Computing, 2017, 20 : 3237 - 3249
  • [23] Bi-level Optimization of Inventory and Production
    Stoilov, Todor
    Stoilova, Krasimira
    CYBERNETICS AND INFORMATION TECHNOLOGIES, 2025, 25 (01) : 126 - 141
  • [24] A bi-level meta-modeling approach for structural optimization using modified POD bases and Diffuse Approximation
    Raghavan, Balaji
    Hamdaoui, Mohamed
    Xiao, Manyu
    Breitkopf, Piotr
    Villon, Pierre
    COMPUTERS & STRUCTURES, 2013, 127 : 19 - 28
  • [25] Bi-Level Optimization in a Transport Network
    Stoilov, Todor
    Stoilova, Krasimira
    Papageorgiou, Markos
    Papamichail, Ioannis
    CYBERNETICS AND INFORMATION TECHNOLOGIES, 2015, 15 (05) : 37 - 49
  • [26] Evolutionary multitasking in bi-level optimization
    Abhishek Gupta
    Jacek Mańdziuk
    Yew-Soon Ong
    Complex & Intelligent Systems, 2015, 1 (1-4) : 83 - 95
  • [27] A bi-level optimization for an HVAC system
    Zhuang, Luping
    Chen, Xi
    Guan, Xiaohong
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2017, 20 (04): : 3237 - 3249
  • [28] BI-LEVEL DYNAMIC OPTIMIZATION WITH FEEDBACK
    Bernstein, Andrey
    Dall'Anese, Emiliano
    2017 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP 2017), 2017, : 553 - 557
  • [29] Joint Unsupervised Learning of Optical Flow and Egomotion with Bi-Level Optimization
    Jiang, Shihao
    Campbell, Dylan
    Liu, Miaomiao
    Gould, Stephen
    Hartley, Richard
    2020 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2020), 2020, : 682 - 691
  • [30] A Nested Bi-level Optimization Framework for Robust Few Shot Learning
    Killamsetty, Krishnateja
    Li, Changbin
    Zhao, Chen
    Chen, Feng
    Iyer, Rishabh
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 7176 - 7184