Cloth-Changing Person Re-identification with Self-Attention

被引:19
|
作者
Bansal, Vaibhav [1 ]
Foresti, Gian Luca [1 ]
Martinel, Niki [1 ]
机构
[1] Univ Udine, Machine Learning & Percept Lab, Udine, Italy
关键词
D O I
10.1109/WACVW54805.2022.00066
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The basic assumption in the standard person reidentification (ReID) problem is that the clothing of the target person IDs would remain constant over long periods. This assumption creates errors during real-world implementations. In addition, most of the methods that handle ReID use CNN-based networks and have found limited success because CNNs can exploit only local dependencies and suffer the loss of information due to the use of down-sampling operations. In this paper, we focus on a more challenging, realistic scenario of long-term cloth-changing ReID (CC-ReID). We aim to learn robust and unique feature representations that are invariant to clothing changes to address the CC-ReID problem. To overcome the limitations faced by CNNs, we propose a Vision-transformer-based framework. We also propose to intuitively exploit the unique soft-biometric-based discriminative information such as gait features and pair them with ViT feature representation for allowing the model to generate long-range structural and contextual relationships that are crucial for re-identification task in the long-term scenario. To evaluate the proposed approach, we perform experiments on two recent CC-ReID datasets, PRCC and LTCC. The experimental results show that the proposed approach achieves state-of-the-art results on the CC-ReID task.
引用
收藏
页码:602 / 610
页数:9
相关论文
共 50 条
  • [31] Self-attention mechanism in person re-identification models
    Wenbai Chen
    Yue Lu
    Hang Ma
    Qili Chen
    Xibao Wu
    Peiliang Wu
    Multimedia Tools and Applications, 2022, 81 : 4649 - 4667
  • [32] Exploring Fine-Grained Representation and Recomposition for Cloth-Changing Person Re-Identification
    Wang, Qizao
    Qian, Xuelin
    Li, Bin
    Xue, Xiangyang
    Fu, Yanwei
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 : 6280 - 6292
  • [33] A multitask tensor-based relation network for cloth-changing person re-identification
    Xu, Jian
    Liu, Bo
    Xiao, Yanshan
    Cao, Fan
    He, Jinghui
    IMAGE AND VISION COMPUTING, 2024, 147
  • [34] An In-depth Exploration of Person Re-identification and Gait Recognition in Cloth-Changing Conditions
    Li, Weijia
    Hou, Saihui
    Zhang, Chunjie
    Cao, Chunshui
    Liu, Xu
    Huang, Yongzhen
    Zhao, Yao
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 13824 - 13833
  • [35] Unified Stability and Plasticity for Lifelong Person Re-Identification in Cloth-Changing and Cloth-Consistent Scenarios
    Yan, Yuming
    Yu, Huimin
    Wang, Yubin
    Song, Shuyi
    Huang, Weihu
    Jin, Juncan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (10) : 9166 - 9180
  • [36] Vision transformer-based robust learning for cloth-changing person re-identification
    Xue, Chen
    Deng, Zhongliang
    Yang, Wangwang
    Hu, Enwen
    Zhang, Yao
    Wang, Shuo
    Wang, Yiming
    APPLIED SOFT COMPUTING, 2024, 163
  • [37] Face and body-shape integration model for cloth-changing person re-identification
    Agbodike, Obinna
    Zhang, Weijin
    Chen, Jenhui
    Wang, Lei
    IMAGE AND VISION COMPUTING, 2023, 140
  • [38] DCR-ReID: Deep Component Reconstruction for Cloth-Changing Person Re-Identification
    Cui, Zhenyu
    Zhou, Jiahuan
    Peng, Yuxin
    Zhang, Shiliang
    Wang, Yaowei
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (08) : 4415 - 4428
  • [39] IRANet: Identity-relevance aware representation for cloth-changing person re-identification
    Shi, Wei
    Liu, Hong
    Liu, Mengyuan
    IMAGE AND VISION COMPUTING, 2022, 117
  • [40] Cloth-Changing Person Re-identification from A Single Image with Gait Prediction and Regularization
    Jin, Xin
    He, Tianyu
    Zheng, Kecheng
    Yin, Zhiheng
    Shen, Xu
    Huang, Zhen
    Feng, Ruoyu
    Huang, Jianqiang
    Chen, Zhibo
    Hua, Xian-Sheng
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 14258 - 14267