Efficient Meta label correction based on Meta Learning and bi-level optimization

被引:7
|
作者
Mallem, Soufiane [1 ,2 ]
Hasnat, Abul [2 ]
Nakib, Amir [2 ]
机构
[1] TCHEK, Marseille, France
[2] Univ Paris Est Creteil, Lab LISSI, Vitry Sur Seine, France
关键词
Deep learning; Bi-level optimization; Meta Learning; Image classification;
D O I
10.1016/j.engappai.2022.105517
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The design of highly accurate deep learning architectures is related to different parameters through different optimizations at different levels of the design. While the architectural design and the training procedure of the neural networks play significant role, the quantity and the quality of the available data remain also very important issues. This research aims to address the quality of the data issue: the data contain imprecise or noisy labels. Numerous approaches have been proposed in the literature to leverage noisy data in case of different noisy labels as well as the strategies and frameworks developed to use the data in practice. Recently, meta-learning based methods have shown good performance to optimize models that take into account the presence of noisy labels within the training dataset. In this work, we propose a new method called Meta label correction via Meta Learning and bi-level optimization (CO-META). It is based on extracting and providing only relevant features to enhance the performance of the label corrector network to tackle the raised problem. The obtained results demonstrate that the proposed method outperforms the state-of-the-art accuracy on the well-known image classification datasets.
引用
收藏
页数:8
相关论文
共 50 条
  • [31] Bi-level Optimization Method for Automatic Reward Shaping of Reinforcement Learning
    Wang, Ludi
    Wang, Zhaolei
    Gong, Qinghai
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2022, PT III, 2022, 13531 : 382 - 393
  • [32] Generic Structure Extraction with Bi-Level Optimization for Graph Structure Learning
    Yin, Nan
    Luo, Zhigang
    ENTROPY, 2022, 24 (09)
  • [33] A Bi-level Meta-heuristic Approach for a Hazardous Waste Management Problem
    Saeidi-Mobarakeh, Z.
    Tavakkoli-Moghaddam, R.
    Navabakhsh, M.
    Amoozad-Khaffli, H.
    INTERNATIONAL JOURNAL OF ENGINEERING, 2020, 33 (07): : 1304 - 1310
  • [34] Spinning Reserve Optimization Model Based on Bi-Level Programming
    Huang Dawei
    Lei Ming
    PROGRESS IN POWER AND ELECTRICAL ENGINEERING, PTS 1 AND 2, 2012, 354-355 : 1047 - 1050
  • [35] Bi-level optimization of charging scheduling of a battery swap station based on deep reinforcement learning
    Tan, Mao
    Dai, Zhuocen
    Su, Yongxin
    Chen, Caixue
    Wang, Ling
    Chen, Jie
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 118
  • [36] Learning in Bi-level Markov Games
    Meng, Linghui
    Ruan, Jingqing
    Xing, Dengpeng
    Xu, Bo
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [37] Bi-level optimization in papermaking process design
    Linnala, Mikko
    Hamalainen, Jari
    NORDIC PULP & PAPER RESEARCH JOURNAL, 2012, 27 (04) : 774 - 782
  • [38] A bi-level optimization model for technology selection
    Aviso, Kathleen B.
    Chiu, Anthony S. F.
    Ubando, Aristotle T.
    Tan, Raymond R.
    JOURNAL OF INDUSTRIAL AND PRODUCTION ENGINEERING, 2021, 38 (08) : 573 - 580
  • [39] Model building using bi-level optimization
    G. K. D. Saharidis
    I. P. Androulakis
    M. G. Ierapetritou
    Journal of Global Optimization, 2011, 49 : 49 - 67
  • [40] A hybrid machine-learning and optimization method to solve bi-level problems
    Bagloee, Saeed Asadi
    Asadi, Mohsen
    Sarvi, Majid
    Patriksson, Michael
    EXPERT SYSTEMS WITH APPLICATIONS, 2018, 95 : 142 - 152