Conditional Feature Embedding by Visual Clue Correspondence Graph for Person Re-Identification

被引:2
|
作者
Yu, Fufu [1 ]
Jiang, Xinyang [1 ,2 ]
Gong, Yifei [1 ]
Zheng, Wei-Shi [3 ,4 ]
Zheng, Feng [5 ,6 ]
Sun, Xing [1 ]
机构
[1] Tencent Technol, Shanghai 200030, Peoples R China
[2] Microsoft Res Asia, Shanghai 200125, Peoples R China
[3] Sun Yat Sen Univ, Sch Informat Sci & Technol, Guangzhou 510275, Peoples R China
[4] Guangdong Prov Key Lab Computat Sci, Guangzhou 510275, Peoples R China
[5] Southern Univ Sci & Technol, Dept Comp Sci & Technol, Shenzhen 518055, Peoples R China
[6] Res Inst Trustworthy Autonomous Syst, Shenzhen 518055, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Visualization; Transformers; Semantics; Fuses; Convolution; Sun; Person re-identification; dynamically adjust; conditional feature; clue alignment; discrepancy-based GCN;
D O I
10.1109/TIP.2022.3206617
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Although Person Re-Identification has made impressive progress, difficult cases like occlusion, change of view-point, and similar clothing still bring great challenges. In order to tackle these challenges, extracting discriminative feature representation is crucial. Most of the existing methods focus on extracting ReID features from individual images separately. However, when matching two images, we propose that the ReID features of a query image should be dynamically adjusted based on the contextual information from the gallery image it matches. We call this type of ReID features conditional feature embedding. In this paper, we propose a novel ReID framework that extracts conditional feature embedding based on the aligned visual clues between image pairs, called Clue Alignment based Conditional Embedding (CACE-Net). CACE-Net applies an attention module to build a detailed correspondence graph between crucial visual clues in image pairs and uses discrepancy-based GCN to embed the obtained complex correspondence information into the conditional features. The experiments show that CACE-Net achieves state-of-the-art performance on three public datasets
引用
收藏
页码:6188 / 6199
页数:12
相关论文
共 50 条
  • [41] A jointly learned deep embedding for person re-identification
    Yuan, Caihong
    Guo, Jingjuan
    Feng, Ping
    Zhao, Zhiqiang
    Xu, Chunyan
    Wang, Tianjiang
    Choe, Gwangmin
    Duan, Kui
    NEUROCOMPUTING, 2019, 330 : 127 - 137
  • [42] A deep person re-identification model with multi visual-semantic information embedding
    Xiaopei Wang
    Xiaoxia Liu
    Jun Guo
    Jiaxiang Zheng
    Pengfei Xu
    Yun Xiao
    Baoying Liu
    Multimedia Tools and Applications, 2021, 80 : 6853 - 6870
  • [43] A deep person re-identification model with multi visual-semantic information embedding
    Wang, Xiaopei
    Liu, Xiaoxia
    Guo, Jun
    Zheng, Jiaxiang
    Xu, Pengfei
    Xiao, Yun
    Liu, Baoying
    MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (05) : 6853 - 6870
  • [44] Multigranular Visual-Semantic Embedding for Cloth-Changing Person Re-identification
    Gao, Zan
    Wei, Hongwei
    Guan, Weili
    Nie, Weizhi
    Liu, Meng
    Wang, Meng
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 3703 - 3711
  • [45] GRAPH CONVOLUTION FOR RE-RANKING IN PERSON RE-IDENTIFICATION
    Zhang, Yuqi
    Qian, Qi
    Liu, Chong
    Chen, Weihua
    Wang, Fan
    Li, Hao
    Jin, Rong
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2704 - 2708
  • [46] A Visual Surveillance System for Person Re-Identification
    El-Alfy, Hazem
    Muramatsu, Daigo
    Teranishi, Yuuichi
    Nishinaga, Nozomu
    Makihara, Yasushi
    Yagi, Yasushi
    THIRTEENTH INTERNATIONAL CONFERENCE ON QUALITY CONTROL BY ARTIFICIAL VISION 2017, 2017, 10338
  • [47] PERSON RE-IDENTIFICATION USING VISUAL ATTENTION
    Rahimpour, Alireza
    Liu, Liu
    Taalimi, Ali
    Song, Yang
    Qi, Hairong
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 4242 - 4246
  • [48] Person Re-identification Based on Visual Saliency
    Liu, Ying
    Shao, Yu
    Sun, Fuchun
    2012 12TH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS DESIGN AND APPLICATIONS (ISDA), 2012, : 884 - 889
  • [49] Person Re-Identification Method Based on the Construction of Graph Convolutional Network with Attribute Feature
    Hu, Xiuhua
    Liang, Yingyu
    Hui, Yan
    Wu, Xi
    Liu, Huan
    Hu, Xuyang
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2022, 36 (12)
  • [50] Person Re-Identification Based on Graph Relation Learning
    Wang, Hao
    Bi, Xiaojun
    NEURAL PROCESSING LETTERS, 2021, 53 (02) : 1401 - 1415