Robust Federated Learning With Noisy Labeled Data Through Loss Function Correction

被引:1
|
作者
Chen, Li [1 ]
Ang, Fan [1 ]
Chen, Yunfei [2 ]
Wang, Weidong [1 ]
机构
[1] Univ Sci & Technol China, Dept Elect Engn & Informat Sci, Hefei 230027, Anhui, Peoples R China
[2] Univ Warwick, Sch Engn, Coventry CV4 7AL, England
基金
中国国家自然科学基金;
关键词
Noise measurement; Training; Servers; Data models; Federated learning; Loss measurement; Convergence; Distributed networks; federated learning; label noise; machine learning; non-convex optimization; parallel and distributed algorithms; robust design;
D O I
10.1109/TNSE.2022.3227287
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Federated learning (FL) is a communication efficient machine learning paradigm to leverage distributed data at the network edge. Nevertheless, FL usually fails to train a high-quality model from the networks, where the edge nodes collect noisy labeled data. To tackle this challenge, this paper focuses on developing an innovative robust FL. We consider two kinds of networks with different data distribution. Firstly, we design a reweighted FL under a full-data network, where all edge nodes are equipped with both numerous noisy labeled dataset and small clean dataset. The key idea is that edge devices learn to assign the local weights of loss functions in noisy labeled dataset, and cooperate with central server to update global weights. Secondly, we consider a part-data network where some edge nodes exclude clean dataset, and can not compute the weights locally. The broadcasting of the global weights is added to help those edge nodes without clean dataset to reweight their noisy loss functions. Both designs have a convergence rate of O(1=T-2). Simulation results illustrate that the both proposed training processes improve the prediction accuracy due to the proper weights assignments of noisy loss function.
引用
收藏
页码:1501 / 1511
页数:11
相关论文
共 50 条
  • [1] Robust Federated Learning With Noisy Labels
    Yang, Seunghan
    Park, Hyoungseob
    Byun, Junyoung
    Kim, Changick
    IEEE INTELLIGENT SYSTEMS, 2022, 37 (02) : 35 - 43
  • [2] Robust Federated Learning With Noisy Communication
    Ang, Fan
    Chen, Li
    Zhao, Nan
    Chen, Yunfei
    Wang, Weidong
    Yu, F. Richard
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2020, 68 (06) : 3452 - 3464
  • [3] Robust Federated Learning with Noisy and Heterogeneous Clients
    Fang, Xiuwen
    Ye, Mang
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 10062 - 10071
  • [4] Robust Federated Learning Over Noisy Fading Channels
    Shah, Suhail M. M.
    Su, Liqun
    Lau, Vincent K. N.
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (09) : 7993 - 8013
  • [5] Overcoming Noisy and Irrelevant Data in Federated Learning
    Tuor, Tiffany
    Wang, Shiqiang
    Ko, Bong Jun
    Liu, Changchang
    Leung, Kin K.
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 5020 - 5027
  • [6] Robust Aggregation Function in Federated Learning
    Taheri, Rahim
    Arabikhan, Farzad
    Gegov, Alexander
    Akbari, Negar
    ADVANCES IN INFORMATION SYSTEMS, ARTIFICIAL INTELLIGENCE AND KNOWLEDGE MANAGEMENT, ICIKS 2023, 2024, 486 : 168 - 175
  • [7] Communication-Efficient Robust Federated Learning with Noisy Labels
    Li, Junyi
    Pei, Jian
    Huang, Heng
    PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022, 2022, : 914 - 924
  • [8] Learning to Learn from Noisy Labeled Data
    Li, Junnan
    Wong, Yongkang
    Zhao, Qi
    Kankanhalli, Mohan S.
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 5046 - 5054
  • [9] Distributionally Robust Federated Learning for Network Traffic Classification With Noisy Labels
    Shi, Siping
    Guo, Yingya
    Wang, Dan
    Zhu, Yifei
    Han, Zhu
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (05) : 6212 - 6226
  • [10] Learning from Noisy Data with Robust Representation Learning
    Li, Junnan
    Xiong, Caiming
    Hoi, Steven C. H.
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 9465 - 9474