Robust Federated Learning With Noisy Labeled Data Through Loss Function Correction

被引:1
|
作者
Chen, Li [1 ]
Ang, Fan [1 ]
Chen, Yunfei [2 ]
Wang, Weidong [1 ]
机构
[1] Univ Sci & Technol China, Dept Elect Engn & Informat Sci, Hefei 230027, Anhui, Peoples R China
[2] Univ Warwick, Sch Engn, Coventry CV4 7AL, England
基金
中国国家自然科学基金;
关键词
Noise measurement; Training; Servers; Data models; Federated learning; Loss measurement; Convergence; Distributed networks; federated learning; label noise; machine learning; non-convex optimization; parallel and distributed algorithms; robust design;
D O I
10.1109/TNSE.2022.3227287
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Federated learning (FL) is a communication efficient machine learning paradigm to leverage distributed data at the network edge. Nevertheless, FL usually fails to train a high-quality model from the networks, where the edge nodes collect noisy labeled data. To tackle this challenge, this paper focuses on developing an innovative robust FL. We consider two kinds of networks with different data distribution. Firstly, we design a reweighted FL under a full-data network, where all edge nodes are equipped with both numerous noisy labeled dataset and small clean dataset. The key idea is that edge devices learn to assign the local weights of loss functions in noisy labeled dataset, and cooperate with central server to update global weights. Secondly, we consider a part-data network where some edge nodes exclude clean dataset, and can not compute the weights locally. The broadcasting of the global weights is added to help those edge nodes without clean dataset to reweight their noisy loss functions. Both designs have a convergence rate of O(1=T-2). Simulation results illustrate that the both proposed training processes improve the prediction accuracy due to the proper weights assignments of noisy loss function.
引用
收藏
页码:1501 / 1511
页数:11
相关论文
共 50 条
  • [41] Breast tumor classification through learning from noisy labeled ultrasound images
    Cao, Zhantao
    Yang, Guowu
    Chen, Qin
    Chen, Xiaolong
    Lv, Fengmao
    MEDICAL PHYSICS, 2020, 47 (03) : 1048 - 1057
  • [42] Auto-weighted Robust Federated Learning with Corrupted Data Sources
    Li, Shenghui
    Ngai, Edith
    Ye, Fanghua
    Voigt, Thiemo
    ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2022, 13 (05)
  • [43] A study on loss function against data imbalance in deep learning correction of precipitation forecasts
    You, Xiao-xiong
    Liang, Zhao-ming
    Wang, Ya-qiang
    Zhang, Hui
    ATMOSPHERIC RESEARCH, 2023, 281
  • [44] A Secure federated learning framework based on autoencoder and Long Short-Term Memory with generalized robust loss function for detection and prevention of data poisoning attacks
    Singh, Preeti
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2025, 102
  • [45] FedCom: Byzantine-Robust Federated Learning Using Data Commitment
    Zhao, Bo
    Wang, Tao
    Fang, Liming
    ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 33 - 38
  • [46] A Novel Robust Stacked Broad Learning System for Noisy Data Regression
    Zheng, Kai
    Liu, Jie
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2024, 15 (02) : 492 - 498
  • [47] A Client Selection Method Based on Loss Function Optimization for Federated Learning
    Zeng, Yan
    Teng, Siyuan
    Xiang, Tian
    Zhang, Jilin
    Mu, Yuankai
    Ren, Yongjian
    Wan, Jian
    CMES-COMPUTER MODELING IN ENGINEERING & SCIENCES, 2023, 137 (01): : 1047 - 1064
  • [48] Robust Recognition of Noisy Speech Through Partial Imputation of Missing Data
    Kian Ebrahim Kafoori
    Seyed Mohammad Ahadi
    Circuits, Systems, and Signal Processing, 2018, 37 : 1625 - 1648
  • [49] Robust Recognition of Noisy Speech Through Partial Imputation of Missing Data
    Kafoori, Kian Ebrahim
    Ahadi, Seyed Mohammad
    CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2018, 37 (04) : 1625 - 1648
  • [50] CRSSC: Salvage Reusable Samples from Noisy Data for Robust Learning
    Sun, Zeren
    Hua, Xian-Sheng
    Yao, Yazhou
    Wei, Xiu-Shen
    Hu, Guosheng
    Zhang, Jian
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 92 - 101