Pose Attention-Guided Paired-Images Generation for Visible-Infrared Person Re-Identification

被引:8
|
作者
Qian, Yongheng [1 ]
Tang, Su-Kit [1 ]
机构
[1] Macao Polytech Univ, Fac Appl Sci, Macau 999078, Peoples R China
关键词
Cross-modality person re-identification; pose-guided; attention mechanism; paired-images;
D O I
10.1109/LSP.2024.3354190
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
A key challenge of visible-infrared person re-identification (VI-ReID) comes from the modality difference between visible and infrared images, which further causes large intra-person and small inter-person distances. Most existing methods design feature extractors and loss functions to bridge the modality gap. However, the unpaired-images constrain the VI-ReID model's ability to learn instance-level alignment features. Different from these methods, in this paper, we propose a pose attention-guided paired-images generation network (PAPG) from the standpoint of data augmentation. PAPG can generate cross-modality paired-images with shape and appearance consistency with the real image to perform instance-level feature alignment by minimizing the distances of every pair of images. Furthermore, our method alleviates data insufficient and reduces the risk of VI-ReID model overfitting. Comprehensive experiments conducted on two publicly available datasets validate the effectiveness and generalizability of PAPG. Especially, on the SYSU-MM01 dataset, our method accomplishes 7.76% and 5.87% gains in Rank-1 and mAP.
引用
收藏
页码:346 / 350
页数:5
相关论文
共 50 条
  • [21] Progressive discrepancy elimination for visible-infrared person re-identification
    Zhang, Guoqing
    Wang, Zhun Zhun
    Wang, Hairui
    Zhou, Jieqiong
    Zheng, Yuhui
    NEUROCOMPUTING, 2024, 607
  • [22] Identity Feature Disentanglement for Visible-Infrared Person Re-Identification
    Chen, Xiumei
    Zheng, Xiangtao
    Lu, Xiaoqiang
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2023, 19 (06)
  • [23] Diffusion Augmentation and Pose Generation Based Pre-Training Method for Robust Visible-Infrared Person Re-Identification
    Sun, Rui
    Huang, Guoxi
    Xie, Ruirui
    Wang, Xuebin
    Chen, Long
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 2670 - 2674
  • [24] Attention guided by human keypoint for infrared-visible person re-identification
    Yu, Peng
    Tian, Xiao-jian
    Qi, Nan
    Piao, Yan
    JOURNAL OF INFRARED AND MILLIMETER WAVES, 2024, 43 (06) : 871 - 878
  • [25] Hybrid Modality Metric Learning for Visible-Infrared Person Re-Identification
    Zhang, La
    Guo, Haiyun
    Zhu, Kuan
    Qiao, Honglin
    Huang, Gaopan
    Zhang, Sen
    Zhang, Huichen
    Sun, Jian
    Wang, Jinqiao
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2022, 18 (01)
  • [26] Visible-infrared person re-identification using query related cluster
    Zhao Q.
    Wu H.
    Huang L.
    Zhu J.
    Zeng H.
    High Technology Letters, 2023, 29 (02) : 194 - 205
  • [27] Grayscale Enhancement Colorization Network for Visible-Infrared Person Re-Identification
    Zhong, Xian
    Lu, Tianyou
    Huang, Wenxin
    Ye, Mang
    Jia, Xuemei
    Lin, Chia-Wen
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (03) : 1418 - 1430
  • [28] Visible-Infrared Person Re-Identification: A Comprehensive Survey and a New Setting
    Zheng, Huantao
    Zhong, Xian
    Huang, Wenxin
    Jiang, Kui
    Liu, Wenxuan
    Wang, Zheng
    ELECTRONICS, 2022, 11 (03)
  • [29] Pose matters: Pose guided graph attention network for person re-identification
    Zhijun HE
    Hongbo ZHAO
    Jianrong WANG
    Wenquan FENG
    Chinese Journal of Aeronautics, 2023, 36 (05) : 447 - 464
  • [30] An efficient framework for visible-infrared cross modality person re-identification
    Basaran, Emrah
    Gokmen, Muhittin
    Kamasak, Mustafa E.
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2020, 87