Exploration of distributed self-supervised training optimization strategies in visual tasks

被引:0
|
作者
Zhang, Xi [1 ]
Wang, Bo [1 ]
Chen, Jiangqi [1 ]
Wang, Jin [1 ]
Chen, Xia [2 ]
机构
[1] China Elect Power Res Inst Co Ltd, Beijing 100192, Peoples R China
[2] State Grid Jinan Power Supply Co, Jinan 250000, Shandong, Peoples R China
关键词
visual tasks; distributed computing; self-supervised; federated learning;
D O I
10.1093/ijlct/ctae222
中图分类号
O414.1 [热力学];
学科分类号
摘要
In response to the growing demand for handling unlabeled data in visual tasks, this paper introduces a novel federated self-supervised learning model (FedSSL), which employs a federated learning framework to conduct distributed model training across multiple decentralized datasets. This model effectively harnesses the unlabeled data that is discreetly distributed among various terminals, thereby collaboratively training high-performance models. Moreover, comparative experiments conducted under standard experimental parameters and on general datasets demonstrate the model's efficacy. FedSSL not only reduces the computational complexity of the model but also enhances classification accuracy.
引用
收藏
页码:2667 / 2675
页数:9
相关论文
共 50 条
  • [1] How Useful is Self-Supervised Pretraining for Visual Tasks?
    Newell, Alejandro
    Deng, Jia
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 7343 - 7352
  • [2] Learning Action Representations for Self-supervised Visual Exploration
    Oh, Changjae
    Cavallaro, Andrea
    2019 INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2019, : 5873 - 5879
  • [3] Accelerating Self-Supervised Learning via Efficient Training Strategies
    Kocyigit, Mustafa Taha
    Hospedales, Timothy M.
    Bilen, Hakan
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 5643 - 5653
  • [4] SELF-SUPERVISED ADVERSARIAL TRAINING
    Chen, Kejiang
    Chen, Yuefeng
    Zhou, Hang
    Mao, Xiaofeng
    Li, Yuhong
    He, Yuan
    Xue, Hui
    Zhang, Weiming
    Yu, Nenghai
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 2218 - 2222
  • [5] Self-Supervised Network Distillation for Exploration
    Zhang, Xu
    Dai, Ruiyu
    Chen, Weisi
    Qiu, Jiguang
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2023, 37 (15)
  • [6] Self-Supervised Exploration via Disagreement
    Pathak, Deepak
    Gandhi, Dhiraj
    Gupta, Abhinav
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [7] Learning online visual invariances for novel objects via supervised and self-supervised training
    Biscione, Valerio
    Bowers, Jeffrey S.
    NEURAL NETWORKS, 2022, 150 : 222 - 236
  • [8] Object Adaptive Self-Supervised Dense Visual Pre-Training
    Zhang, Yu
    Zhang, Tao
    Zhu, Hongyuan
    Chen, Zihan
    Mi, Siya
    Peng, Xi
    Geng, Xin
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2025, 34 : 2228 - 2240
  • [9] UniVIP: A Unified Framework for Self-Supervised Visual Pre-training
    Li, Zhaowen
    Zhu, Yousong
    Yang, Fan
    Li, Wei
    Zhao, Chaoyang
    Chen, Yingying
    Chen, Zhiyang
    Xie, Jiahao
    Wu, Liwei
    Zhao, Rui
    Tang, Ming
    Wang, Jinqiao
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 14607 - 14616
  • [10] Dense Contrastive Learning for Self-Supervised Visual Pre-Training
    Wang, Xinlong
    Zhang, Rufeng
    Shen, Chunhua
    Kong, Tao
    Li, Lei
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 3023 - 3032