Conditional Feature Embedding by Visual Clue Correspondence Graph for Person Re-Identification

被引:2
|
作者
Yu, Fufu [1 ]
Jiang, Xinyang [1 ,2 ]
Gong, Yifei [1 ]
Zheng, Wei-Shi [3 ,4 ]
Zheng, Feng [5 ,6 ]
Sun, Xing [1 ]
机构
[1] Tencent Technol, Shanghai 200030, Peoples R China
[2] Microsoft Res Asia, Shanghai 200125, Peoples R China
[3] Sun Yat Sen Univ, Sch Informat Sci & Technol, Guangzhou 510275, Peoples R China
[4] Guangdong Prov Key Lab Computat Sci, Guangzhou 510275, Peoples R China
[5] Southern Univ Sci & Technol, Dept Comp Sci & Technol, Shenzhen 518055, Peoples R China
[6] Res Inst Trustworthy Autonomous Syst, Shenzhen 518055, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Visualization; Transformers; Semantics; Fuses; Convolution; Sun; Person re-identification; dynamically adjust; conditional feature; clue alignment; discrepancy-based GCN;
D O I
10.1109/TIP.2022.3206617
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Although Person Re-Identification has made impressive progress, difficult cases like occlusion, change of view-point, and similar clothing still bring great challenges. In order to tackle these challenges, extracting discriminative feature representation is crucial. Most of the existing methods focus on extracting ReID features from individual images separately. However, when matching two images, we propose that the ReID features of a query image should be dynamically adjusted based on the contextual information from the gallery image it matches. We call this type of ReID features conditional feature embedding. In this paper, we propose a novel ReID framework that extracts conditional feature embedding based on the aligned visual clues between image pairs, called Clue Alignment based Conditional Embedding (CACE-Net). CACE-Net applies an attention module to build a detailed correspondence graph between crucial visual clues in image pairs and uses discrepancy-based GCN to embed the obtained complex correspondence information into the conditional features. The experiments show that CACE-Net achieves state-of-the-art performance on three public datasets
引用
收藏
页码:6188 / 6199
页数:12
相关论文
共 50 条
  • [1] Graph Correspondence Transfer for Person Re-Identification
    Zhou, Qin
    Fan, Heng
    Zheng, Shibao
    Su, Hang
    Li, Xinzhe
    Wu, Shuang
    Ling, Haibin
    THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 7599 - 7606
  • [2] HOMOCENTRIC HYPERSPHERE FEATURE EMBEDDING FOR PERSON RE-IDENTIFICATION
    Xiang, Wangmeng
    Huang, Jianqiang
    Qi, Xianbiao
    Hua, Xiansheng
    Zhang, Lei
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 1237 - 1241
  • [3] Deep feature learning via structured graph Laplacian embedding for person re-identification
    Cheng, De
    Gong, Yihong
    Chang, Xiaojun
    Shi, Weiwei
    Hauptmann, Alexander
    Zheng, Nanning
    PATTERN RECOGNITION, 2018, 82 : 94 - 104
  • [4] Robust and Efficient Graph Correspondence Transfer for Person Re-Identification
    Zhou, Qin
    Fan, Heng
    Yang, Hua
    Su, Hang
    Zheng, Shibao
    Wu, Shuang
    Ling, Haibin
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 1623 - 1638
  • [5] Centralized embedding hypersphere feature learning for person re-identification
    Wang, Yuanyuan
    Wang, Zhijian
    Jiang, Mingxin
    IMAGING SCIENCE JOURNAL, 2019, 67 (06): : 295 - 304
  • [6] Salient feature based graph matching for person re-identification
    Iodice, Sara
    Petrosino, Alfredo
    PATTERN RECOGNITION, 2015, 48 (04) : 1074 - 1085
  • [7] Relation-Preserving Feature Embedding for Unsupervised Person Re-Identification
    Wang, Xueping
    Liu, Min
    Wang, Fei
    Dai, Jianhua
    Liu, An-An
    Wang, Yaonan
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 714 - 723
  • [8] Neural Architectures for Feature Embedding in Person Re-Identification: A Comparative View
    Dominguez-Martin, Javier
    Gomez-Silva, Maria J.
    De La Escalera, Arturo
    ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2023, 14 (05)
  • [9] Visible-Infrared Person Re-identification Combining Visual-Textual Matching and Graph Embedding
    Zhang, Hongying
    Fan, Shiyu
    Luo, Qian
    Zhang, Tao
    Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2024, 46 (09): : 3662 - 3671
  • [10] Multi-graph feature level fusion for person re-identification
    An, Le
    Chen, Xiaojing
    Yang, Songfan
    NEUROCOMPUTING, 2017, 259 : 39 - 45