Conditional Feature Embedding by Visual Clue Correspondence Graph for Person Re-Identification

被引:2
|
作者
Yu, Fufu [1 ]
Jiang, Xinyang [1 ,2 ]
Gong, Yifei [1 ]
Zheng, Wei-Shi [3 ,4 ]
Zheng, Feng [5 ,6 ]
Sun, Xing [1 ]
机构
[1] Tencent Technol, Shanghai 200030, Peoples R China
[2] Microsoft Res Asia, Shanghai 200125, Peoples R China
[3] Sun Yat Sen Univ, Sch Informat Sci & Technol, Guangzhou 510275, Peoples R China
[4] Guangdong Prov Key Lab Computat Sci, Guangzhou 510275, Peoples R China
[5] Southern Univ Sci & Technol, Dept Comp Sci & Technol, Shenzhen 518055, Peoples R China
[6] Res Inst Trustworthy Autonomous Syst, Shenzhen 518055, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Visualization; Transformers; Semantics; Fuses; Convolution; Sun; Person re-identification; dynamically adjust; conditional feature; clue alignment; discrepancy-based GCN;
D O I
10.1109/TIP.2022.3206617
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Although Person Re-Identification has made impressive progress, difficult cases like occlusion, change of view-point, and similar clothing still bring great challenges. In order to tackle these challenges, extracting discriminative feature representation is crucial. Most of the existing methods focus on extracting ReID features from individual images separately. However, when matching two images, we propose that the ReID features of a query image should be dynamically adjusted based on the contextual information from the gallery image it matches. We call this type of ReID features conditional feature embedding. In this paper, we propose a novel ReID framework that extracts conditional feature embedding based on the aligned visual clues between image pairs, called Clue Alignment based Conditional Embedding (CACE-Net). CACE-Net applies an attention module to build a detailed correspondence graph between crucial visual clues in image pairs and uses discrepancy-based GCN to embed the obtained complex correspondence information into the conditional features. The experiments show that CACE-Net achieves state-of-the-art performance on three public datasets
引用
收藏
页码:6188 / 6199
页数:12
相关论文
共 50 条
  • [21] MARGIN-EMBEDDING CANONICAL CORRELATION ANALYSIS WITH FEATURE SELECTION FOR PERSON RE-IDENTIFICATION
    Ma, Linfei
    Zhang, Xiang
    Lan, Long
    Huang, Xuhui
    Luo, Zhigang
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 1648 - 1652
  • [22] Deep feature embedding learning for person re-identification based on lifted structured loss
    He, Zhangping
    Jung, Cheolkon
    Fu, Qingtao
    Zhang, Zhendong
    MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (05) : 5863 - 5880
  • [23] Dual-alignment Feature Embedding for Cross-modality Person Re-identification
    Hao, Yi
    Wang, Nannan
    Gao, Xinbo
    Li, Jie
    Wang, Xiaoyu
    PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 57 - 65
  • [24] DEEP FEATURE EMBEDDING LEARNING FOR PERSON RE-IDENTIFICATION USING LIFTED STRUCTURED LOSS
    He, Zhangping
    Zhang, Zhendong
    Jung, Cheolkon
    2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 1957 - 1961
  • [25] Deep feature embedding learning for person re-identification based on lifted structured loss
    Zhangping He
    Cheolkon Jung
    Qingtao Fu
    Zhendong Zhang
    Multimedia Tools and Applications, 2019, 78 : 5863 - 5880
  • [26] Deep Feature Ranking for Person Re-Identification
    Nie, Jie
    Huang, Lei
    Zhang, Wenfeng
    Wei, Guanqun
    Wei, Zhiqiang
    IEEE ACCESS, 2019, 7 : 15007 - 15017
  • [27] Learning Semantic Representation on Visual Attribute Graph for Person Re-identification and Beyond
    Tang, Geyu
    Gao, Xingyu
    Chen, Zhenyu
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2023, 19 (06)
  • [28] Omnidirectional Feature Learning for Person Re-Identification
    Wu, Di
    Yang, Hong-Wei
    Huang, De-Shuang
    Yuan, Chang-An
    Qin, Xiao
    Zhao, Yang
    Zhao, Xin-Yong
    Sun, Jian-Hong
    IEEE ACCESS, 2019, 7 : 28402 - 28411
  • [29] A feature enhancement loss for person re-identification
    Peng, Yao
    Lin, Yining
    Ni, Huajian
    Gao, Hua
    Hu, Chenchen
    SYSTEMS SCIENCE & CONTROL ENGINEERING, 2023, 11 (01)
  • [30] Feature mask network for person re-identification
    Ding, Guodong
    Khan, Salman
    Tang, Zhenmin
    Porikli, Fatih
    PATTERN RECOGNITION LETTERS, 2020, 137 : 91 - 98