Robust Federated Learning With Noisy Labeled Data Through Loss Function Correction

被引:1
|
作者
Chen, Li [1 ]
Ang, Fan [1 ]
Chen, Yunfei [2 ]
Wang, Weidong [1 ]
机构
[1] Univ Sci & Technol China, Dept Elect Engn & Informat Sci, Hefei 230027, Anhui, Peoples R China
[2] Univ Warwick, Sch Engn, Coventry CV4 7AL, England
基金
中国国家自然科学基金;
关键词
Noise measurement; Training; Servers; Data models; Federated learning; Loss measurement; Convergence; Distributed networks; federated learning; label noise; machine learning; non-convex optimization; parallel and distributed algorithms; robust design;
D O I
10.1109/TNSE.2022.3227287
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Federated learning (FL) is a communication efficient machine learning paradigm to leverage distributed data at the network edge. Nevertheless, FL usually fails to train a high-quality model from the networks, where the edge nodes collect noisy labeled data. To tackle this challenge, this paper focuses on developing an innovative robust FL. We consider two kinds of networks with different data distribution. Firstly, we design a reweighted FL under a full-data network, where all edge nodes are equipped with both numerous noisy labeled dataset and small clean dataset. The key idea is that edge devices learn to assign the local weights of loss functions in noisy labeled dataset, and cooperate with central server to update global weights. Secondly, we consider a part-data network where some edge nodes exclude clean dataset, and can not compute the weights locally. The broadcasting of the global weights is added to help those edge nodes without clean dataset to reweight their noisy loss functions. Both designs have a convergence rate of O(1=T-2). Simulation results illustrate that the both proposed training processes improve the prediction accuracy due to the proper weights assignments of noisy loss function.
引用
收藏
页码:1501 / 1511
页数:11
相关论文
共 50 条
  • [31] Overcoming Noisy Labels and Non-IID Data in Edge Federated Learning
    Xu, Yang
    Liao, Yunming
    Wang, Lun
    Xu, Hongli
    Jiang, Zhida
    Zhang, Wuyang
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (12) : 11406 - 11421
  • [32] Learning statistical models of phenotypes using noisy labeled training data
    Agarwal, Vibhu
    Podchiyska, Tanya
    Banda, Juan M.
    Goel, Veena
    Leung, Tiffany I.
    Minty, Evan P.
    Sweeney, Timothy E.
    Gyang, Elsie
    Shah, Nigam H.
    JOURNAL OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION, 2016, 23 (06) : 1166 - 1173
  • [33] Robust Incentive Mechanism of Federated Learning for Data Quality Uncertainty
    Wang, Chao
    Li, Bingze
    Yang, Yang
    INFORMATION TECHNOLOGY AND CONTROL, 2024, 53 (04):
  • [34] An improved noise loss correction algorithm for learning from noisy labels
    Zhang, Qian
    Lee, Feifei
    Wang, Ya-gang
    Miao, Ran
    Chen, Lei
    Chen, Qiu
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2020, 72
  • [35] Making federated learning robust to adversarial attacks by learning data and model association
    Qayyum, Adnan
    Janjua, Muhammad Umar
    Qadir, Junaid
    COMPUTERS & SECURITY, 2022, 121
  • [36] Learning Robust Data-Based LQG Controllers From Noisy Data
    Liu, Wenjie
    Wang, Gang
    Sun, Jian
    Bullo, Francesco
    Chen, Jie
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2024, 69 (12) : 8526 - 8538
  • [37] EQUAL LOSS: A SIMPLE LOSS FUNCTION FOR NOISE ROBUST LEARNING
    Cui, Lei
    Peng, Huan
    Li, Yangguang
    Li, Chuming
    Xing, Xingrun
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 1950 - 1954
  • [38] Tackling Data Heterogeneity in Federated Learning via Loss Decomposition
    Zeng, Shuang
    Guo, Pengxin
    Wang, Shuai
    Wang, Jianbo
    Zhou, Yuyin
    Qu, Liangqiong
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT X, 2024, 15010 : 707 - 717
  • [39] A Robust Detection and Correction Framework for GNN-Based Vertical Federated Learning
    Yang, Zhicheng
    Fan, Xiaoliang
    Wang, Zheng
    Wang, Zihui
    Wang, Cheng
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT III, 2024, 14427 : 97 - 108
  • [40] FLForest: Byzantine-robust Federated Learning through Isolated Forest
    Wang, Tao
    Zhao, Bo
    Fang, Liming
    2022 IEEE 28TH INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS, ICPADS, 2022, : 296 - 303