Group Re-Identification With Group Context Graph Neural Networks

被引:23
|
作者
Zhu, Ji [1 ,2 ]
Yang, Hua [1 ]
Lin, Weiyao [1 ]
Liu, Nian [3 ]
Wang, Jia [1 ]
Zhang, Wenjun [1 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Elect Engn, Shanghai 200240, Peoples R China
[2] Visbody Inc, Shanghai 200240, Peoples R China
[3] Mohamed Bin Zayed Univ Artificial Intelligence, Abu Dhabi 54115, U Arab Emirates
基金
中国国家自然科学基金;
关键词
Layout; Feature extraction; Cameras; Task analysis; Kernel; Training; Measurement; Group re-identification; spatial K-NN graph; group context graph neural network; MODEL;
D O I
10.1109/TMM.2020.3013531
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Group re-identification aims to match groups of people across disjoint cameras. In this task, the contextual information from neighbor individuals can be exploited for re-identifying each individual within the group as well as the entire group. However, compared with single person re-identification, it brings new challenges including group layout and group membership changes. Motivated by the observation that individuals who are close together are more likely to keep in the same group under different cameras than those who are far apart, we propose to model each group as a spatial K-nearest neighbor graph (SKNNG) and design a group context graph neural network (GCGNN) for graph representation learning. Specifically, for each node in the graph, the proposed GCGNN learns an embedding which aggregates the contextual information from neighbor nodes. We design multiple weighting kernels for neighborhood aggregation based on the graph properties including node in-degrees and spatial relationship attributes. We compute the similarity scores between node embeddings of two graphs for group member association and obtain the matching score between the two graphs by summing up the similarity scores of all linked node pairs. Experimental results on three public datasets show that our approach performs favorably against state-of-the-art methods and achieves high efficiency.
引用
收藏
页码:2614 / 2626
页数:13
相关论文
共 50 条
  • [41] Deep Group-shuffling Random Walk for Person Re-identification
    Shen, Yantao
    Li, Hongsheng
    Xiao, Tong
    Yi, Shuai
    Chen, Dapeng
    Wang, Xiaogang
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 2265 - 2274
  • [42] Uncertainty Modeling with Second-Order Transformer for Group Re-identification
    Zhang, Quan
    Lai, Jian-Huang
    Feng, Zhanxiang
    Xie, Xiaohua
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 3318 - 3325
  • [43] Similarity Metric Learning For RGB-Infrared Group Re-Identification
    Xiong, Jianghao
    Lai, Jianhuang
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 13662 - 13671
  • [44] Group Re-Identification via Unsupervised Transfer of Sparse Features Encoding
    Lisanti, Giuseppe
    Martinel, Niki
    Del Bimbo, Alberto
    Foresti, Gian Luca
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 2468 - 2477
  • [45] Group affinity guided deep hypergraph model for person re-identification
    Zeng, Qixun
    Yu, Huimin
    ELECTRONICS LETTERS, 2019, 55 (04) : 186 - 187
  • [46] Group Sparsity Tensor Factorization for Re-Identification of Open Mobility Traces
    Murakami, Takao
    Kanemura, Atsunori
    Hino, Hideitsu
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2017, 12 (03) : 689 - 704
  • [47] A user-based framework for group re-identification in still images
    Salamon, Nestor Z.
    Jacques Junior, Julio C. S.
    Musse, Soraia R.
    2015 IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA (ISM), 2015, : 315 - 318
  • [48] Group Re-Identification: Leveraging and Integrating Multi-Grain Information
    Xiao, Hao
    Lin, Weiyao
    Sheng, Bin
    Lu, Ke
    Yan, Junchi
    Wang, Jingdong
    Ding, Errui
    Zhang, Yihao
    Xiong, Hongkai
    PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, : 192 - 200
  • [49] GDMN: Group Decision-Making Network for Person Re-Identification
    Liu, Yang
    Sheng, Hao
    Zheng, Yanwei
    Chen, Nengcheng
    Ke, Wei
    Xiong, Zhang
    IEEE ACCESS, 2018, 6 : 64169 - 64181
  • [50] Cross-domain person re-identification using graph convolutional networks
    Pan S.
    Wang Y.
    Chong Y.
    Chong, Yanwen (ywchong@whu.edu.cn), 1600, Huazhong University of Science and Technology (48): : 44 - 49