Group Re-Identification With Group Context Graph Neural Networks

被引:23
|
作者
Zhu, Ji [1 ,2 ]
Yang, Hua [1 ]
Lin, Weiyao [1 ]
Liu, Nian [3 ]
Wang, Jia [1 ]
Zhang, Wenjun [1 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Elect Engn, Shanghai 200240, Peoples R China
[2] Visbody Inc, Shanghai 200240, Peoples R China
[3] Mohamed Bin Zayed Univ Artificial Intelligence, Abu Dhabi 54115, U Arab Emirates
基金
中国国家自然科学基金;
关键词
Layout; Feature extraction; Cameras; Task analysis; Kernel; Training; Measurement; Group re-identification; spatial K-NN graph; group context graph neural network; MODEL;
D O I
10.1109/TMM.2020.3013531
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Group re-identification aims to match groups of people across disjoint cameras. In this task, the contextual information from neighbor individuals can be exploited for re-identifying each individual within the group as well as the entire group. However, compared with single person re-identification, it brings new challenges including group layout and group membership changes. Motivated by the observation that individuals who are close together are more likely to keep in the same group under different cameras than those who are far apart, we propose to model each group as a spatial K-nearest neighbor graph (SKNNG) and design a group context graph neural network (GCGNN) for graph representation learning. Specifically, for each node in the graph, the proposed GCGNN learns an embedding which aggregates the contextual information from neighbor nodes. We design multiple weighting kernels for neighborhood aggregation based on the graph properties including node in-degrees and spatial relationship attributes. We compute the similarity scores between node embeddings of two graphs for group member association and obtain the matching score between the two graphs by summing up the similarity scores of all linked node pairs. Experimental results on three public datasets show that our approach performs favorably against state-of-the-art methods and achieves high efficiency.
引用
收藏
页码:2614 / 2626
页数:13
相关论文
共 50 条
  • [31] Vehicle Re-identification by Fusing Multiple Deep Neural Networks
    Cui, Chao
    Sang, Nong
    Gao, Changxin
    Zou, Lei
    PROCEEDINGS OF THE 2017 SEVENTH INTERNATIONAL CONFERENCE ON IMAGE PROCESSING THEORY, TOOLS AND APPLICATIONS (IPTA 2017), 2017,
  • [32] Deep Neural Networks with Inexact Matching for Person Re-Identification
    Subramaniam, Arulkumar
    Chatterjee, Moitreya
    Mittal, Anurag
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 29 (NIPS 2016), 2016, 29
  • [33] Convolutional Neural Networks for Vehicle Re-identification with Adversarial Loss
    Shang, Linzhi
    Liu, Lizhen
    Song, Wei
    Zhao, Xinlei
    Du, Chao
    PROCEEDINGS OF 2019 IEEE 9TH INTERNATIONAL CONFERENCE ON ELECTRONICS INFORMATION AND EMERGENCY COMMUNICATION (ICEIEC 2019), 2019, : 117 - 121
  • [34] New approach to the re-identification problem using neural networks
    Nin, Jordi
    Torra, Vicenc
    MODELING DECISIONS FOR ARTIFICIAL INTELLIGENCE, 2006, 3885 : 251 - 261
  • [35] Progressive Context-Aware Graph Feature Learning for Target Re-Identification
    Cao, Min
    Ding, Cong
    Chen, Chen
    Dou, Hao
    Hu, Xiyuan
    Yan, Junchi
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 1230 - 1242
  • [36] Groups Re-identification with Temporal Context
    Koperski, Michal
    Bak, Slawomir
    Carr, Peter
    PROCEEDINGS OF THE 2017 ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL (ICMR'17), 2017, : 214 - 222
  • [37] Migrate demographic group for fair Graph Neural Networks
    Hu, Yanming
    Liao, Tianchi
    Chen, Jialong
    Bian, Jing
    Zheng, Zibin
    Chen, Chuan
    NEURAL NETWORKS, 2024, 175
  • [38] Person Re-identification with Deep Similarity-Guided Graph Neural Network
    Shen, Yantao
    Li, Hongsheng
    Yi, Shuai
    Chen, Dapeng
    Wang, Xiaogang
    COMPUTER VISION - ECCV 2018, PT 15, 2018, 11219 : 508 - 526
  • [39] Adaptive Feature Fusion via Graph Neural Network for Person Re-identification
    Li, Yaoyu
    Yao, Hantao
    Duan, Lingyu
    Yao, Hanxing
    Xu, Changsheng
    PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 2115 - 2123
  • [40] CONSISTENT MATCHING BASED ON BOOSTED SALIENCE CHANNELS FOR GROUP RE-IDENTIFICATION
    Zhu, Feng
    Chu, Qi
    Yu, Nenghai
    2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 4279 - 4283