Conditional Feature Embedding by Visual Clue Correspondence Graph for Person Re-Identification

被引:2
|
作者
Yu, Fufu [1 ]
Jiang, Xinyang [1 ,2 ]
Gong, Yifei [1 ]
Zheng, Wei-Shi [3 ,4 ]
Zheng, Feng [5 ,6 ]
Sun, Xing [1 ]
机构
[1] Tencent Technol, Shanghai 200030, Peoples R China
[2] Microsoft Res Asia, Shanghai 200125, Peoples R China
[3] Sun Yat Sen Univ, Sch Informat Sci & Technol, Guangzhou 510275, Peoples R China
[4] Guangdong Prov Key Lab Computat Sci, Guangzhou 510275, Peoples R China
[5] Southern Univ Sci & Technol, Dept Comp Sci & Technol, Shenzhen 518055, Peoples R China
[6] Res Inst Trustworthy Autonomous Syst, Shenzhen 518055, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Visualization; Transformers; Semantics; Fuses; Convolution; Sun; Person re-identification; dynamically adjust; conditional feature; clue alignment; discrepancy-based GCN;
D O I
10.1109/TIP.2022.3206617
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Although Person Re-Identification has made impressive progress, difficult cases like occlusion, change of view-point, and similar clothing still bring great challenges. In order to tackle these challenges, extracting discriminative feature representation is crucial. Most of the existing methods focus on extracting ReID features from individual images separately. However, when matching two images, we propose that the ReID features of a query image should be dynamically adjusted based on the contextual information from the gallery image it matches. We call this type of ReID features conditional feature embedding. In this paper, we propose a novel ReID framework that extracts conditional feature embedding based on the aligned visual clues between image pairs, called Clue Alignment based Conditional Embedding (CACE-Net). CACE-Net applies an attention module to build a detailed correspondence graph between crucial visual clues in image pairs and uses discrepancy-based GCN to embed the obtained complex correspondence information into the conditional features. The experiments show that CACE-Net achieves state-of-the-art performance on three public datasets
引用
收藏
页码:6188 / 6199
页数:12
相关论文
共 50 条
  • [31] Appearance feature enhancement for person re-identification
    Zhang, Wenfeng
    Huang, Lei
    Wei, Zhiqiang
    Nie, Jie
    EXPERT SYSTEMS WITH APPLICATIONS, 2021, 163
  • [32] Spectral Feature Transformation for Person Re-Identification
    Luo, Chuanchen
    Chen, Yuntao
    Wang, Naiyan
    Zhang, Zhaoxiang
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 4975 - 4984
  • [33] Feature Completion for Occluded Person Re-Identification
    Hou, Ruibing
    Ma, Bingpeng
    Chang, Hong
    Gu, Xinqian
    Shan, Shiguang
    Chen, Xilin
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (09) : 4894 - 4912
  • [34] A FEATURE FUSION STRATEGY FOR PERSON RE-IDENTIFICATION
    Gao, Mu
    Ai, Haizhou
    Bai, Bo
    2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 4274 - 4278
  • [35] Progressive Feature Enhancement for Person Re-Identification
    Zhong, Yingji
    Wang, Yaowei
    Zhang, Shiliang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 8384 - 8395
  • [36] Person Re-Identification Based on Feature Stitching
    Pan Tong
    Li Wenguo
    LASER & OPTOELECTRONICS PROGRESS, 2019, 56 (16)
  • [37] Siamese Cosine Network Embedding for Person Re-identification
    Wang, Jiabao
    Li, Yang
    Miao, Zhuang
    COMPUTER VISION, PT III, 2017, 773 : 352 - 362
  • [38] Person Re-Identification Based on View Information Embedding
    Bi Xiaojun
    Wang Hao
    ACTA OPTICA SINICA, 2019, 39 (06)
  • [39] PERSON RE-IDENTIFICATION BASED ON VIEWPOINT CORRESPONDENCE PATTERN
    Lin, Lan
    Liu, Dan
    Li, Xudong
    Zhang, Feng
    Ye, Mao
    2017 14TH INTERNATIONAL COMPUTER CONFERENCE ON WAVELET ACTIVE MEDIA TECHNOLOGY AND INFORMATION PROCESSING (ICCWAMTIP), 2017, : 116 - 119
  • [40] Person Re-Identification Based on Contour Information Embedding
    Chen, Hao
    Zhao, Yan
    Wang, Shigang
    SENSORS, 2023, 23 (02)