Generalizing to unseen domains via PatchMix

被引:1
|
作者
Yang, Juncheng [1 ,3 ]
Li, Zuchao [2 ]
Li, Chao [4 ]
Xie, Shuai [5 ]
Yu, Wei [1 ]
Li, Shijun [1 ]
机构
[1] Wuhan Univ, Sch Comp Sci, Wuhan 430072, Hubei, Peoples R China
[2] Wuhan Univ, Natl Engn Res Ctr Multimedia Software, Sch Comp Sci, Wuhan 430072, Hubei, Peoples R China
[3] Henan Polytech Inst, Sch Elect & Informat Engn, Nanyang 473000, Henan, Peoples R China
[4] JD Hlth Int Inc, Beijing, Peoples R China
[5] JD Explore Acad, Beijing, Peoples R China
关键词
Domain generalization; PatchMix; Domain discriminator; Vision transformer; Data augmentation;
D O I
10.1007/s00530-023-01213-8
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Domain generalization (DG) aims to transfer knowledge learned from multiple source domains to unseen domains. One of the primary challenges hinders DG is the insufficient diversity of source domains, which hampers the model's ability to learn to generalize. Traditional data augmentation methods, which fuse content, style, labels, etc., unable to effectively learn the global features from the source domains. In this paper, we present an innovative approach to domain generalization learning technique, called PatchMix, by stitching the patches of different source domains together to build domain-mixup samples. This approach helps the model to learn the common features of different source domains. Meanwhile, a domain discriminator is introduced to preserve the model's ability to distinguish the source domains, which is proved to be helpful for the model to generalize to unseen domains. To our best knowledge, we are the first to unveil the equation that elucidates the correlation between the number of patches and the number of source domains. Our method, PatchMix, outperforms the current state-of-the-art (SOTA) on four benchmark datasets.
引用
收藏
页数:16
相关论文
共 50 条
  • [21] OoD-Control: Generalizing Control in Unseen Environments
    Ye, Nanyang
    Zeng, Zhaoyu
    Zhou, Jundong
    Zhu, Lin
    Duan, Yuxiao
    Wu, Yifei
    Wu, Junqi
    Zeng, Haoqi
    Gu, Qinying
    Wang, Xinbing
    Zhou, Chenghu
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (11) : 7421 - 7433
  • [22] Generalizing to Unseen Elements: A Survey on Knowledge Extrapolation for Knowledge Graphs
    Chen, Mingyang
    Zhang, Wen
    Geng, Yuxia
    Xu, Zezhong
    Pan, Jeff Z.
    Chen, Huajun
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 6574 - 6582
  • [23] GENERALIZING HYPERTEXT - DOMAINS OF THE TRELLIS MODEL
    FURUTA, R
    STOTTS, PD
    TSI-TECHNIQUE ET SCIENCE INFORMATIQUES, 1990, 9 (06): : 493 - 503
  • [24] Generalization on Unseen Domains via Model-Agnostic Learning for Intelligent Fault Diagnosis
    Wang, Huanjie
    Bai, Xiwei
    Wang, Sihan
    Tan, Jie
    Liu, Chengbao
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [25] Transfer Metric Learning for Unseen Domains
    Atsutoshi Kumagai
    Tomoharu Iwata
    Yasuhiro Fujiwara
    Data Science and Engineering, 2020, 5 : 140 - 151
  • [26] Transfer Metric Learning for Unseen Domains
    Kumagai, Atsutoshi
    Iwata, Tomoharu
    Fujiwara, Yasuhiro
    DATA SCIENCE AND ENGINEERING, 2020, 5 (02) : 140 - 151
  • [27] Transfer Metric Learning for Unseen Domains
    Kumagai, Atsutoshi
    Iwata, Tomoharu
    Fujiwara, Yasuhiro
    2019 19TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2019), 2019, : 1168 - 1173
  • [28] Speaker Attractor Network: Generalizing Speech Separation to Unseen Numbers of Sources
    Jiang, Fei
    Duan, Zhiyao
    IEEE SIGNAL PROCESSING LETTERS, 2020, 27 : 1859 - 1863
  • [29] COCOA: Context-Conditional Adaptation for Recognizing Unseen Classes in Unseen Domains
    Mangla, Puneet
    Chandhok, Shivam
    Balasubramanian, Vineeth N.
    Khan, Fahad Shahbaz
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 1618 - 1627