Efficient Meta label correction based on Meta Learning and bi-level optimization

被引:7
|
作者
Mallem, Soufiane [1 ,2 ]
Hasnat, Abul [2 ]
Nakib, Amir [2 ]
机构
[1] TCHEK, Marseille, France
[2] Univ Paris Est Creteil, Lab LISSI, Vitry Sur Seine, France
关键词
Deep learning; Bi-level optimization; Meta Learning; Image classification;
D O I
10.1016/j.engappai.2022.105517
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The design of highly accurate deep learning architectures is related to different parameters through different optimizations at different levels of the design. While the architectural design and the training procedure of the neural networks play significant role, the quantity and the quality of the available data remain also very important issues. This research aims to address the quality of the data issue: the data contain imprecise or noisy labels. Numerous approaches have been proposed in the literature to leverage noisy data in case of different noisy labels as well as the strategies and frameworks developed to use the data in practice. Recently, meta-learning based methods have shown good performance to optimize models that take into account the presence of noisy labels within the training dataset. In this work, we propose a new method called Meta label correction via Meta Learning and bi-level optimization (CO-META). It is based on extracting and providing only relevant features to enhance the performance of the label corrector network to tackle the raised problem. The obtained results demonstrate that the proposed method outperforms the state-of-the-art accuracy on the well-known image classification datasets.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] Task-aware world model learning with meta weighting via bi-level optimization
    Yuan, Huining
    Dou, Hongkun
    Jiang, Xingyu
    Deng, Yue
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [2] LABO: Towards Learning Optimal Label Regularization via Bi-level Optimization
    Lu, Peng
    Rashid, Ahmad
    Kobyzev, Ivan
    Rezagholizadeh, Mehdi
    Langlais, Philippe
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL 2023, 2023, : 5759 - 5774
  • [3] Efficient Bi-Level Optimization for Recommendation Denoising
    Wang, Zongwei
    Gao, Min
    Li, Wentao
    Yu, Junliang
    Guo, Linxin
    Yin, Hongzhi
    PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 2502 - 2511
  • [4] Meta Label Correction for Noisy Label Learning
    Zheng, Guoqing
    Awadallah, Ahmed Hassan
    Dumais, Susan
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 11053 - 11061
  • [5] Bi-level Meta-learning for Few-shot Domain Generalization
    Qin, Xiaorong
    Song, Xinhang
    Jiang, Shuqiang
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 15900 - 15910
  • [6] Transfer Learning Based Evolutionary Algorithm for Bi-level Optimization Problems
    Chen, Lei
    Liu, Hai-Lin
    2021 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC 2021), 2021, : 1643 - 1647
  • [7] Bi-level optimal configuration method of hybrid energy storage system based on meta model optimization algorithm
    He J.
    Shi C.
    Ma M.
    Huo Q.
    Xin K.
    Wei T.
    Dianli Zidonghua Shebei/Electric Power Automation Equipment, 2020, 40 (07): : 157 - 164
  • [8] Learning Intrinsic Rewards as a Bi-Level Optimization Problem
    Zhang, Lunjun
    Stadie, Bradly C.
    Ba, Jimmy
    CONFERENCE ON UNCERTAINTY IN ARTIFICIAL INTELLIGENCE (UAI 2020), 2020, 124 : 111 - 120
  • [9] Bi-Level Selection via Meta Gradient for Graph-Based Fraud Detection
    Dong, Linfeng
    Liu, Yang
    Ao, Xiang
    Chi, Jianfeng
    Feng, Jinghua
    Yang, Hao
    He, Qing
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, DASFAA 2022, PT I, 2022, : 387 - 394
  • [10] A Bi-level Formulation for Label Noise Learning with Spectral Cluster Discovery
    Luo, Yijing
    Han, Bo
    Gong, Chen
    PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 2605 - 2611