DFR-ST: Discriminative feature representation with spatio-temporal cues for vehicle re-identification

被引:11
|
作者
Tu, Jingzheng [1 ,2 ,3 ]
Chen, Cailian [1 ,2 ,3 ]
Huang, Xiaolin [1 ,2 ,3 ]
He, Jianping [1 ,2 ,3 ]
Guan, Xinping [1 ,2 ,3 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Automat, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Key Lab Syst Control & Informat Proc, Minist Educ China, Shanghai 200240, Peoples R China
[3] Shanghai Engn Res Ctr Intelligent Control & Manage, Shanghai 200240, Peoples R China
基金
中国国家自然科学基金;
关键词
Vehicle re -identification; Computer vision; Deep learning; Attention mechanism; Video surveillance;
D O I
10.1016/j.patcog.2022.108887
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Vehicle re-identification (re-ID) aims to discover and match the target vehicles from a gallery image set taken by different cameras on a wide range of road networks. It is crucial for lots of applications such as security surveillance and traffic management. The remarkably similar appearances of distinct vehicles and the significant changes in viewpoints and illumination conditions pose grand challenges to vehicle re-ID. Conventional solutions focus on designing global visual appearances without sufficient consideration of vehicles' spatio-temporal relationships in different images. This paper proposes a discriminative feature representation with spatio-temporal clues (DFR-ST) for vehicle re-ID. It is capable of building robust fea-tures in the embedding space by involving appearance and spatio-temporal information. The proposed DFR-ST constructs an appearance model for a multi-grained visual representation by a two-stream archi-tecture and a spatio-temporal metric to provide complementary information based on this multi-modal information. Experimental results on four public datasets demonstrate DFR-ST outperforms the state-of-the-art methods, which validates the effectiveness of the proposed method. (c) 2022 Published by Elsevier Ltd.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] Video-Based Pedestrian Re-Identification by Adaptive Spatio-Temporal Appearance Model
    Zhang, Wei
    Ma, Bingpeng
    Liu, Kan
    Huang, Rui
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (04) : 2042 - 2054
  • [32] Part-based spatio-temporal model for multi-person re-identification
    Bedagkar-Gala, A.
    Shah, Shishir K.
    PATTERN RECOGNITION LETTERS, 2012, 33 (14) : 1908 - 1915
  • [33] Co-Saliency Spatio-Temporal Interaction Network for Person Re-Identification in Videos
    Liu, Jiawei
    Zha, Zheng-Jun
    Zhu, Xierong
    Jiang, Na
    PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 1012 - 1018
  • [34] Towards Discriminative Representation Learning for Unsupervised Person Re-identification
    Isobe, Takashi
    Li, Dong
    Tian, Lu
    Chen, Weihua
    Shan, Yi
    Wang, Shengjin
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 8506 - 8516
  • [35] Discriminative Feature Learning With Foreground Attention for Person Re-Identification
    Zhou, Sanping
    Wang, Jinjun
    Meng, Deyu
    Liang, Yudong
    Gong, Yihong
    Zheng, Nanning
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (09) : 4671 - 4684
  • [36] Discriminative feature mining with relation regularization for person re-identification
    Yang, Jing
    Zhang, Canlong
    Li, Zhixin
    Tang, Yanping
    Wang, Zhiwen
    INFORMATION PROCESSING & MANAGEMENT, 2023, 60 (03)
  • [37] DEEP JOINT DISCRIMINATIVE LEARNING FOR VEHICLE RE-IDENTIFICATION AND RETRIEVAL
    Li, Yuqi
    Li, Yanghao
    Yan, Hongfei
    Liu, Jiaying
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 395 - 399
  • [38] Hybrid generative-discriminative hash tracking with spatio-temporal contextual cues
    Dai, Manna
    Cheng, Shuying
    He, Xiangjian
    NEURAL COMPUTING & APPLICATIONS, 2018, 29 (02): : 389 - 399
  • [39] Exploring High-Order Spatio-Temporal Correlations From Skeleton for Person Re-Identification
    Lu, Jiaxuan
    Wan, Hai
    Li, Peiyan
    Zhao, Xibin
    Ma, Nan
    Gao, Yue
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 949 - 963
  • [40] ASTA-Net: Adaptive Spatio-Temporal Attention Network for Person Re-Identification in Videos
    Zhu, Xierong
    Liu, Jiawei
    Wu, Haoze
    Wang, Meng
    Zha, Zheng-Jun
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 1706 - 1715