A framework for self-supervised federated domain adaptation

被引:0
|
作者
Bin Wang
Gang Li
Chao Wu
WeiShan Zhang
Jiehan Zhou
Ye Wei
机构
[1] China University of Petroleum (East),College of Computer Science and Technology
[2] ZheJiang University,School of Public Affairs
[3] University of Oulu,undefined
[4] Suzhou Tongji Blockchain Research Institute,undefined
关键词
Domain adaptation; Distributed system; Self-supervised; Federated learning;
D O I
暂无
中图分类号
学科分类号
摘要
Unsupervised federated domain adaptation uses the knowledge from several distributed unlabelled source domains to complete the learning on the unlabelled target domain. Some of the existing methods have limited effectiveness and involve frequent communication. This paper proposes a framework to solve the distributed multi-source domain adaptation problem, referred as self-supervised federated domain adaptation (SFDA). Specifically, a multi-domain model generalization balance is proposed to aggregate the models from multiple source domains in each round of communication. A weighted strategy based on centroid similarity is also designed for SFDA. SFDA conducts self-supervised training on the target domain to tackle domain shift. Compared with the classical federated adversarial domain adaptation algorithm, SFDA is not only strong in communication cost and privacy protection but also improves in the accuracy of the model.
引用
收藏
相关论文
共 50 条
  • [41] Generic network for domain adaptation based on self-supervised learning and deep clustering
    Baffour, Adu Asare
    Qin, Zhen
    Geng, Ji
    Ding, Yi
    Deng, Fuhu
    Qin, Zhiguang
    NEUROCOMPUTING, 2022, 476 : 126 - 136
  • [42] Self-Supervised Graph Neural Network for Multi-Source Domain Adaptation
    Yuan, Jin
    Hou, Feng
    Du, Yangzhou
    Shi, Zhongchao
    Geng, Xin
    Fan, Jianping
    Rui, Yong
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 3907 - 3916
  • [43] MoDA: Map Style Transfer for Self-supervised Domain Adaptation of Embodied Agents
    Lee, Eun Sun
    Kim, Junho
    Park, SangWon
    Kim, Young Min
    COMPUTER VISION, ECCV 2022, PT XXXIX, 2022, 13699 : 338 - 354
  • [44] Unsupervised Person Re-Identification with Iterative Self-Supervised Domain Adaptation
    Tang, Haotian
    Zhao, Yiru
    Lu, Hongtao
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, : 1536 - 1543
  • [45] Improving Distortion Robustness of Self-supervised Speech Processing Tasks with Domain Adaptation
    Huang, Kuan Po
    Fu, Yu-Kuan
    Zhang, Yu
    Lee, Hung-yi
    INTERSPEECH 2022, 2022, : 2193 - 2197
  • [46] Self-Supervised Boundary Point Prediction Task for Point Cloud Domain Adaptation
    Chen, Jintao
    Zhang, Yan
    Huang, Kun
    Ma, Feifan
    Tan, Zhuangbin
    Xu, Zheyu
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (09) : 5878 - 5885
  • [47] Generative and self-supervised domain adaptation for one-stage object detection
    Fujii, Kazuma
    Kawamoto, Kazuhiko
    ARRAY, 2021, 11
  • [48] CONTINUAL SELF-SUPERVISED DOMAIN ADAPTATION FOR END-TO-END SPEAKER DIARIZATION
    Coria, Juan M.
    Bredin, Herve
    Ghannay, Sahar
    Rosset, Sophie
    2022 IEEE SPOKEN LANGUAGE TECHNOLOGY WORKSHOP, SLT, 2022, : 626 - 632
  • [49] FEDERATED SELF-SUPERVISED LEARNING FOR ACOUSTIC EVENT CLASSIFICATION
    Feng, Meng
    Kao, Chieh-Chi
    Tang, Qingming
    Sun, Ming
    Rozgic, Viktor
    Matsoukas, Spyros
    Wang, Chao
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 481 - 485
  • [50] BADFSS: Backdoor Attacks on Federated Self-Supervised Learning
    Zhang, Jiale
    Zhu, Chengcheng
    Di Wu
    Sun, Xiaobing
    Yong, Jianming
    Long, Guodong
    PROCEEDINGS OF THE THIRTY-THIRD INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2024, 2024, : 548 - 558