Group Re-Identification With Group Context Graph Neural Networks

被引:23
|
作者
Zhu, Ji [1 ,2 ]
Yang, Hua [1 ]
Lin, Weiyao [1 ]
Liu, Nian [3 ]
Wang, Jia [1 ]
Zhang, Wenjun [1 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Elect Engn, Shanghai 200240, Peoples R China
[2] Visbody Inc, Shanghai 200240, Peoples R China
[3] Mohamed Bin Zayed Univ Artificial Intelligence, Abu Dhabi 54115, U Arab Emirates
基金
中国国家自然科学基金;
关键词
Layout; Feature extraction; Cameras; Task analysis; Kernel; Training; Measurement; Group re-identification; spatial K-NN graph; group context graph neural network; MODEL;
D O I
10.1109/TMM.2020.3013531
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Group re-identification aims to match groups of people across disjoint cameras. In this task, the contextual information from neighbor individuals can be exploited for re-identifying each individual within the group as well as the entire group. However, compared with single person re-identification, it brings new challenges including group layout and group membership changes. Motivated by the observation that individuals who are close together are more likely to keep in the same group under different cameras than those who are far apart, we propose to model each group as a spatial K-nearest neighbor graph (SKNNG) and design a group context graph neural network (GCGNN) for graph representation learning. Specifically, for each node in the graph, the proposed GCGNN learns an embedding which aggregates the contextual information from neighbor nodes. We design multiple weighting kernels for neighborhood aggregation based on the graph properties including node in-degrees and spatial relationship attributes. We compute the similarity scores between node embeddings of two graphs for group member association and obtain the matching score between the two graphs by summing up the similarity scores of all linked node pairs. Experimental results on three public datasets show that our approach performs favorably against state-of-the-art methods and achieves high efficiency.
引用
收藏
页码:2614 / 2626
页数:13
相关论文
共 50 条
  • [1] Person Re-identification Using Group Context
    Chen, Yiqiang
    Duffner, Stefan
    Stoian, Andrei
    Dufour, Jean-Yves
    Baskurt, Atilla
    ADVANCED CONCEPTS FOR INTELLIGENT VISION SYSTEMS, ACIVS 2018, 2018, 11182 : 392 - 401
  • [2] Learning Multi-Attention Context Graph for Group-Based Re-Identification
    Yan, Yichao
    Qin, Jie
    Ni, Bingbing
    Chen, Jiaxin
    Liu, Li
    Zhu, Fan
    Zheng, Wei-Shi
    Yang, Xiaokang
    Shao, Ling
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (06) : 7001 - 7018
  • [3] Person Re-identification Based On Group Context Strategy
    Xu, Kaihang
    Zhang, Dongping
    Sun, Min
    Yang, Li
    PROCEEDINGS OF 8TH INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTATION TECHNOLOGY AND AUTOMATION (ICICTA 2015), 2015, : 638 - 641
  • [4] DoT-GNN: Domain-Transferred Graph Neural Network for Group Re-identification
    Huang, Ziling
    Wang, Zheng
    Hu, Wei
    Lin, Chia-Wen
    Satoh, Shin'ichi
    PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 1888 - 1896
  • [5] Neural Image Parts Group Search for Person Re-Identification
    Liu, Zhipu
    Zhang, Lei
    Zhang, David
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (06) : 2724 - 2737
  • [6] Uncertainty Modeling for Group Re-Identification
    Zhang, Quan
    Lai, Jianhuang
    Feng, Zhanxiang
    Xie, Xiaohua
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024, 132 (08) : 3046 - 3066
  • [7] Person Re-identification Using Group Constraint
    Mei, Ling
    Lai, Jianhuang
    Feng, Zhanxiang
    Chen, Zeyu
    Xie, Xiaohua
    INTELLIGENCE SCIENCE AND BIG DATA ENGINEERING: VISUAL DATA ENGINEERING, PT I, 2019, 11935 : 459 - 471
  • [8] Person Re-Identification Using Group Information
    Bialkowski, Alina
    Lucey, Patrick
    Wei, Xinyu
    Sridharan, Sridha
    2013 INTERNATIONAL CONFERENCE ON DIGITAL IMAGE COMPUTING: TECHNIQUES & APPLICATIONS (DICTA), 2013, : 104 - 109
  • [9] Re-identification of Vessels with Convolutional Neural Networks
    Ghahremani, Amir
    Kong, Yitian
    Bondarev, Egor
    de With, Peter H. N.
    PROCEEDINGS OF THE 2019 5TH INTERNATIONAL CONFERENCE ON COMPUTER AND TECHNOLOGY APPLICATIONS (ICCTA 2019), 2019, : 93 - 97
  • [10] Learning global and local features using graph neural networks for person re-identification
    Zhang, Ji
    Ainam, Jean-Paul
    Song, Wenai
    Zhao, Li-hui
    Wang, Xin
    Li, Hongzhou
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2022, 107