Group Re-Identification With Group Context Graph Neural Networks

被引:23
|
作者
Zhu, Ji [1 ,2 ]
Yang, Hua [1 ]
Lin, Weiyao [1 ]
Liu, Nian [3 ]
Wang, Jia [1 ]
Zhang, Wenjun [1 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Elect Engn, Shanghai 200240, Peoples R China
[2] Visbody Inc, Shanghai 200240, Peoples R China
[3] Mohamed Bin Zayed Univ Artificial Intelligence, Abu Dhabi 54115, U Arab Emirates
基金
中国国家自然科学基金;
关键词
Layout; Feature extraction; Cameras; Task analysis; Kernel; Training; Measurement; Group re-identification; spatial K-NN graph; group context graph neural network; MODEL;
D O I
10.1109/TMM.2020.3013531
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Group re-identification aims to match groups of people across disjoint cameras. In this task, the contextual information from neighbor individuals can be exploited for re-identifying each individual within the group as well as the entire group. However, compared with single person re-identification, it brings new challenges including group layout and group membership changes. Motivated by the observation that individuals who are close together are more likely to keep in the same group under different cameras than those who are far apart, we propose to model each group as a spatial K-nearest neighbor graph (SKNNG) and design a group context graph neural network (GCGNN) for graph representation learning. Specifically, for each node in the graph, the proposed GCGNN learns an embedding which aggregates the contextual information from neighbor nodes. We design multiple weighting kernels for neighborhood aggregation based on the graph properties including node in-degrees and spatial relationship attributes. We compute the similarity scores between node embeddings of two graphs for group member association and obtain the matching score between the two graphs by summing up the similarity scores of all linked node pairs. Experimental results on three public datasets show that our approach performs favorably against state-of-the-art methods and achieves high efficiency.
引用
收藏
页码:2614 / 2626
页数:13
相关论文
共 50 条
  • [21] Recurrent Neural Networks for Person Re-identification Revisited
    Boin, Jean-Baptiste
    Araujo, Andre
    Girod, Bernd
    2019 2ND IEEE CONFERENCE ON MULTIMEDIA INFORMATION PROCESSING AND RETRIEVAL (MIPR 2019), 2019, : 147 - 152
  • [22] Spatial Preserved Graph Convolution Networks for Person Re-identification
    Li, Zhaoju
    Zhou, Zongwei
    Jiang, Nan
    Han, Zhenjun
    Xing, Junliang
    Jiao, Jianbin
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2020, 16 (01)
  • [23] Local Convolutional Neural Networks for Person Re-Identification
    Yang, Jiwei
    Shen, Xu
    Tian, Xinmei
    Li, Houqiang
    Huang, Jianqiang
    Hua, Xian-Sheng
    PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, : 1074 - 1082
  • [24] Modeling 3D Layout For Group Re-Identification
    Zhang, Quan
    Dang, Kaiheng
    Lai, Jian-Huang
    Feng, Zhanxiang
    Xie, Xiaohua
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 7502 - 7510
  • [25] Group Re-identification via Transferred Representation and Adaptive Fusion
    Huang, Ziling
    Wang, Zheng
    Hung, Tzu-Yi
    Satoh, Shin'ichi
    Lin, Chia-Wen
    2019 IEEE FIFTH INTERNATIONAL CONFERENCE ON MULTIMEDIA BIG DATA (BIGMM 2019), 2019, : 128 - 132
  • [26] Adaptive Memorization With Group Labels for Unsupervised Person Re-Identification
    Peng, Jinjia
    Jiang, Guangqi
    Wang, Huibing
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (10) : 5802 - 5813
  • [27] GROUP RE-IDENTIFICATION WITH HYBRID ATTENTION MODEL AND RESIDUAL DISTANCE
    Xu, Qiling
    Yang, Hua
    Chen, Lin
    Zhai, Guangtao
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 1217 - 1221
  • [28] Part-guided graph convolution networks for person re-identification
    Zhang, Zhong
    Zhang, Haijia
    Liu, Shuang
    Xie, Yuan
    Durrani, Tariq S.
    PATTERN RECOGNITION, 2021, 120
  • [29] Person Re-identification using Heterogeneous Local Graph Attention Networks
    Zhang, Zhong
    Zhang, Haijia
    Liu, Shuang
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 12131 - 12140
  • [30] Pixel-wise Graph Attention Networks for Person Re-identification
    Zhang, Wenyu
    Ding, Qing
    Hu, Jian
    Ma, Yi
    Lu, Mingzhe
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 5231 - 5238