Source-Data-Free Cross-Domain Knowledge Transfer for Semantic Segmentation

被引:0
|
作者
Li, Zongyao [1 ]
Togo, Ren [2 ]
Ogawa, Takahiro [2 ]
Haseyama, Miki [2 ]
机构
[1] Hokkaido Univ, Grad Sch Informat Sci & Technol, Sapporo, Hokkaido 0600814, Japan
[2] Hokkaido Univ, Fac Informat Sci & Technol, Sapporo, Hokkaido 0600814, Japan
关键词
Training; Adaptation models; Semantic segmentation; Data models; Semantics; Uncertainty; Signal processing; Domain adaptation; semantic segmentation; source-data-free domain adaptation; style transfer;
D O I
10.1109/OJSP.2023.3340616
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This article proposes a method for transferring knowledge of semantic segmentation from a labeled source domain to an unlabeled target domain without using the source-domain data. Such a problem is called source-data-free domain adaptation, in which a pre-trained source-domain model and the unlabeled target-domain data are used to transfer the label knowledge across the domains. Like most previous methods, our method uses pseudo labels for distilling and transferring the source-domain knowledge. On the basis of the pseudo-label learning, our method improves the domain adaptation performance in two innovative ways: 1) reducing the domain differences by source-data-free style transfer and 2) exploring the style diversity within the target domain by style modification. To this end, we introduce two additional modules: 1) an inter-domain style transfer module which aligns the feature statistics of the source and target domains before producing the pseudo labels thereby improving the pseudo labels' accuracy, and 2) an intra-domain style modification module which modifies the image styles within the target domain for learning intra-domain style-invariant features. Our method with the two modules outperforms previous source-data-free domain adaptation methods in two commonly used benchmarks. Moreover, our method is well compatible with the previous methods for further improvement.
引用
收藏
页码:92 / 100
页数:9
相关论文
共 50 条
  • [1] Crots: Cross-Domain Teacher–Student Learning for Source-Free Domain Adaptive Semantic Segmentation
    Xin Luo
    Wei Chen
    Zhengfa Liang
    Longqi Yang
    Siwei Wang
    Chen Li
    International Journal of Computer Vision, 2024, 132 : 20 - 39
  • [2] Crots: Cross-Domain Teacher-Student Learning for Source-Free Domain Adaptive Semantic Segmentation
    Luo, Xin
    Chen, Wei
    Liang, Zhengfa
    Yang, Longqi
    Wang, Siwei
    Li, Chen
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024, 132 (01) : 20 - 39
  • [3] Cross-Domain Semantic Segmentation via Domain-Invariant Interactive Relation Transfer
    Lv, Fengmao
    Liang, Tao
    Chen, Xiang
    Lin, Guosheng
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 4333 - 4342
  • [4] Cross-Modal and Cross-Domain Knowledge Transfer for Label-Free 3D Segmentation
    Zhang, Jingyu
    Yang, Huitong
    Wu, Dai-Jie
    Keung, Jacky
    Li, Xuesong
    Zhu, Xinge
    Ma, Yuexin
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT III, 2024, 14427 : 465 - 477
  • [5] Cross-Domain Grouping and Alignment for Domain Adaptive Semantic Segmentation
    Kim, Minsu
    Joung, Sunghun
    Kim, Seungryong
    Park, Jungin
    Kim, Ig-Jae
    Sohn, Kwanghoon
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 1799 - 1807
  • [6] Cross-Domain and Cross-Modal Knowledge Distillation in Domain Adaptation for 3D Semantic Segmentation
    Li, Miaoyu
    Zhang, Yachao
    Xie, Yuan
    Gao, Zuodong
    Li, Cuihua
    Zhang, Zhizhong
    Qu, Yanyun
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 3829 - 3837
  • [7] Informative Data Mining for One-shot Cross-Domain Semantic Segmentation
    Wang, Yuxi
    Liang, Jian
    Xiao, Jun
    Mei, Shuqi
    Yang, Yuran
    Zhang, Zhaoxiang
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 1064 - 1074
  • [8] Cross-Domain Few-Shot Semantic Segmentation
    Lei, Shuo
    Zhang, Xuchao
    He, Jianfeng
    Chen, Fanglan
    Du, Bowen
    Lu, Chang-Tien
    COMPUTER VISION - ECCV 2022, PT XXX, 2022, 13690 : 73 - 90
  • [9] TACS: Taxonomy Adaptive Cross-Domain Semantic Segmentation
    Gong, Rui
    Danelljan, Martin
    Dai, Dengxin
    Paudel, Danda Pani
    Chhatkuli, Ajad
    Yu, Fisher
    Van Gool, Luc
    COMPUTER VISION, ECCV 2022, PT XXXIV, 2022, 13694 : 19 - 35
  • [10] A global reweighting approach for cross-domain semantic segmentation
    Zhang, Yuhang
    Tian, Shishun
    Liao, Muxin
    Hua, Guoguang
    Zou, Wenbin
    Xu, Chen
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2025, 130