Style Interleaved Learning for Generalizable Person Re-Identification

被引:15
|
作者
Tan, Wentao [1 ]
Ding, Changxing [2 ,3 ]
Wang, Pengfei [4 ]
Gong, Mingming [5 ]
Jia, Kui [2 ]
机构
[1] South China Univ Technol, Sch Future Technol, Guangzhou 510000, Peoples R China
[2] South China Univ Technol, Sch Elect & Informat Engn, Guangzhou 510000, Peoples R China
[3] PazhouLab, Guangzhou 510330, Peoples R China
[4] Hong Kong Polytech Univ, Dept Comp, Hung Hom, Hong Kong, Peoples R China
[5] Univ Melbourne, Sch Math & Stat, Melbourne, Vic 3010, Australia
基金
中国国家自然科学基金;
关键词
Domain generalization; interleaved learning; person re-identification; DOMAIN; NETWORK;
D O I
10.1109/TMM.2023.3283878
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Domain generalization (DG) for person re-identification (ReID) is a challenging problem, as access to target domain data is not permitted during the training process. Most existing DG ReID methods update the feature extractor and classifier parameters based on the same features. This common practice causes the model to overfit to existing feature styles in the source domain, resulting in sub-optimal generalization ability on target domains. To solve this problem, we propose a novel style interleaved learning (IL) framework. Unlike conventional learning strategies, IL incorporates two forward propagations and one backward propagation for each iteration. We employ the features of interleaved styles to update the feature extractor and classifiers using different forward propagations, which helps to prevent the model from overfitting to certain domain styles. To generate interleaved feature styles, we further propose a new feature stylization approach. It produces a wide range of meaningful styles that are both different and independent from the original styles in the source domain, which caters to the IL methodology. Extensive experimental results show that our model not only consistently outperforms state-of-the-art methods on large-scale benchmarks for DG ReID, but also has clear advantages in computational efficiency.
引用
收藏
页码:1600 / 1612
页数:13
相关论文
共 50 条
  • [1] Style Variable and Irrelevant Learning for Generalizable Person Re-identification
    Lv, Kai
    Chen, Haobo
    Zhao, Chuyang
    Tu, Kai
    Chen, Junru
    Li, Yadong
    Li, Boxun
    Lin, Youfang
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (09)
  • [2] Style Normalization and Restitution for Generalizable Person Re-identification
    Jin, Xin
    Lan, Cuiling
    Zeng, Wenjun
    Chen, Zhibo
    Zhang, Li
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 3140 - 3149
  • [3] Style-unaware meta-learning for generalizable person re-identification
    Shao, Jie
    Cai, Pengpeng
    JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (05)
  • [4] Style Elimination and Information Restitution for generalizable person re-identification
    Zhao, Qian
    Yu, Wentao
    Ji, Tangyu
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 98
  • [5] Revisiting Stochastic Learning for Generalizable Person Re-identification
    Zhao, Jiajian
    Zhao, Yifan
    Chen, Xiaowu
    Li, Jia
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 1758 - 1768
  • [6] Style Uncertainty Based Self-Paced Meta Learning for Generalizable Person Re-Identification
    Zhang, Lei
    Liu, Zhipu
    Zhang, Wensheng
    Zhang, David
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 2107 - 2119
  • [7] Learning Domain Invariant Representations for Generalizable Person Re-Identification
    Zhang, Yi-Fan
    Zhang, Zhang
    Li, Da
    Jia, Zhen
    Wang, Liang
    Tan, Tieniu
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 509 - 523
  • [8] Label Distribution Learning for Generalizable Multisource Person Re-Identification
    Qi, Lei
    Shen, Jiaying
    Liu, Jiaqi
    Shi, Yinghuan
    Geng, Xin
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2022, 17 : 3139 - 3150
  • [9] Deep multimodal representation learning for generalizable person re-identification
    Xiang, Suncheng
    Chen, Hao
    Ran, Wei
    Yu, Zefang
    Liu, Ting
    Qian, Dahong
    Fu, Yuzhuo
    MACHINE LEARNING, 2024, 113 (04) : 1921 - 1939
  • [10] Deep multimodal representation learning for generalizable person re-identification
    Suncheng Xiang
    Hao Chen
    Wei Ran
    Zefang Yu
    Ting Liu
    Dahong Qian
    Yuzhuo Fu
    Machine Learning, 2024, 113 : 1921 - 1939