Pose Attention-Guided Paired-Images Generation for Visible-Infrared Person Re-Identification

被引:8
|
作者
Qian, Yongheng [1 ]
Tang, Su-Kit [1 ]
机构
[1] Macao Polytech Univ, Fac Appl Sci, Macau 999078, Peoples R China
关键词
Cross-modality person re-identification; pose-guided; attention mechanism; paired-images;
D O I
10.1109/LSP.2024.3354190
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
A key challenge of visible-infrared person re-identification (VI-ReID) comes from the modality difference between visible and infrared images, which further causes large intra-person and small inter-person distances. Most existing methods design feature extractors and loss functions to bridge the modality gap. However, the unpaired-images constrain the VI-ReID model's ability to learn instance-level alignment features. Different from these methods, in this paper, we propose a pose attention-guided paired-images generation network (PAPG) from the standpoint of data augmentation. PAPG can generate cross-modality paired-images with shape and appearance consistency with the real image to perform instance-level feature alignment by minimizing the distances of every pair of images. Furthermore, our method alleviates data insufficient and reduces the risk of VI-ReID model overfitting. Comprehensive experiments conducted on two publicly available datasets validate the effectiveness and generalizability of PAPG. Especially, on the SYSU-MM01 dataset, our method accomplishes 7.76% and 5.87% gains in Rank-1 and mAP.
引用
收藏
页码:346 / 350
页数:5
相关论文
共 50 条
  • [1] Discovering attention-guided cross-modality correlation for visible-infrared person re-identification
    Yu, Hao
    Cheng, Xu
    Cheng, Kevin Ho Man
    Peng, Wei
    Yu, Zitong
    Zhao, Guoying
    PATTERN RECOGNITION, 2024, 155
  • [2] Pose-driven attention-guided image generation for person re-Identification
    Khatun, Amena
    Denman, Simon
    Sridharan, Sridha
    Fookes, Clinton
    PATTERN RECOGNITION, 2023, 137
  • [3] Cross-Modality Paired-Images Generation for RGB-Infrared Person Re-Identification
    Wang, Guan-An
    Zhang, Tianzhu
    Yang, Yang
    Cheng, Jian
    Chang, Jianlong
    Liang, Xu
    Hou, Zeng-Guang
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 12144 - 12151
  • [4] Cross-modality paired-images generation and augmentation for RGB-infrared person re-identification
    Wang, Guan'an
    Yang, Yang
    Zhang, Tianzhu
    Cheng, Jian
    Hou, Zengguang
    Tiwari, Prayag
    Pandey, Hari Mohan
    NEURAL NETWORKS, 2020, 128 : 294 - 304
  • [5] Occluded Visible-Infrared Person Re-Identification
    Feng, Yujian
    Ji, Yimu
    Wu, Fei
    Gao, Guangwei
    Gao, Yang
    Liu, Tianliang
    Liu, Shangdong
    Jing, Xiao-Yuan
    Luo, Jiebo
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 1401 - 1413
  • [6] Auxiliary Representation Guided Network for Visible-Infrared Person Re-Identification
    Qi, Mengzan
    Chan, Sixian
    Hang, Chen
    Zhang, Guixu
    Zeng, Tieyong
    Li, Zhi
    IEEE TRANSACTIONS ON MULTIMEDIA, 2025, 27 : 340 - 355
  • [7] Unified Conditional Image Generation for Visible-Infrared Person Re-Identification
    Pan, Honghu
    Pei, Wenjie
    Li, Xin
    He, Zhenyu
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 : 9026 - 9038
  • [8] Mask-guided dual attention-aware network for visible-infrared person re-identification
    Qi, Meibin
    Wang, Suzhi
    Huang, Guanghong
    Jiang, Jianguo
    Wu, Jingjing
    Chen, Cuiqun
    MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (12) : 17645 - 17666
  • [9] Attributes Based Visible-Infrared Person Re-identification
    Zheng, Aihua
    Feng, Mengya
    Pan, Peng
    Jiang, Bo
    Luo, Bin
    PATTERN RECOGNITION AND COMPUTER VISION, PT I, PRCV 2022, 2022, 13534 : 254 - 266
  • [10] Mask-guided dual attention-aware network for visible-infrared person re-identification
    Meibin Qi
    Suzhi Wang
    Guanghong Huang
    Jianguo Jiang
    Jingjing Wu
    Cuiqun Chen
    Multimedia Tools and Applications, 2021, 80 : 17645 - 17666