DFR-ST: Discriminative feature representation with spatio-temporal cues for vehicle re-identification

被引:11
|
作者
Tu, Jingzheng [1 ,2 ,3 ]
Chen, Cailian [1 ,2 ,3 ]
Huang, Xiaolin [1 ,2 ,3 ]
He, Jianping [1 ,2 ,3 ]
Guan, Xinping [1 ,2 ,3 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Automat, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Key Lab Syst Control & Informat Proc, Minist Educ China, Shanghai 200240, Peoples R China
[3] Shanghai Engn Res Ctr Intelligent Control & Manage, Shanghai 200240, Peoples R China
基金
中国国家自然科学基金;
关键词
Vehicle re -identification; Computer vision; Deep learning; Attention mechanism; Video surveillance;
D O I
10.1016/j.patcog.2022.108887
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Vehicle re-identification (re-ID) aims to discover and match the target vehicles from a gallery image set taken by different cameras on a wide range of road networks. It is crucial for lots of applications such as security surveillance and traffic management. The remarkably similar appearances of distinct vehicles and the significant changes in viewpoints and illumination conditions pose grand challenges to vehicle re-ID. Conventional solutions focus on designing global visual appearances without sufficient consideration of vehicles' spatio-temporal relationships in different images. This paper proposes a discriminative feature representation with spatio-temporal clues (DFR-ST) for vehicle re-ID. It is capable of building robust fea-tures in the embedding space by involving appearance and spatio-temporal information. The proposed DFR-ST constructs an appearance model for a multi-grained visual representation by a two-stream archi-tecture and a spatio-temporal metric to provide complementary information based on this multi-modal information. Experimental results on four public datasets demonstrate DFR-ST outperforms the state-of-the-art methods, which validates the effectiveness of the proposed method. (c) 2022 Published by Elsevier Ltd.
引用
收藏
页数:13
相关论文
共 50 条
  • [21] Progressive Unsupervised Person Re-Identification by Tracklet Association With Spatio-Temporal Regularization
    Xie, Qiaokang
    Zhou, Wengang
    Qi, Guo-Jun
    Tian, Qi
    Li, Houqiang
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 : 597 - 610
  • [22] Large-Scale Spatio-Temporal Person Re-Identification: Algorithms and Benchmark
    Shu, Xiujun
    Wang, Xiao
    Zang, Xianghao
    Zhang, Shiliang
    Chen, Yuanqi
    Li, Ge
    Tian, Qi
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (07) : 4390 - 4403
  • [23] Progressive Unsupervised Person Re-Identification by Tracklet Association with Spatio-Temporal Regularization
    Xie, Qiaokang
    Zhou, Wengang
    Qi, Guo-Jun
    Tian, Qi
    Li, Houqiang
    IEEE Transactions on Multimedia, 2021, 23 : 597 - 610
  • [24] Discriminative feature and dictionary learning with part-aware model for vehicle re-identification
    Wang, Huibing
    Peng, Jinjia
    Jiang, Guangqi
    Xu, Fengqiang
    Fu, Xianping
    NEUROCOMPUTING, 2021, 438 : 55 - 62
  • [25] Discriminative Spatial Feature Learning for Person Re-Identification
    Peng, Peixi
    Tian, Yonghong
    Huang, Yangru
    Wang, Xiangqian
    An, Huilong
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 274 - 283
  • [26] Hybrid generative–discriminative hash tracking with spatio-temporal contextual cues
    Manna Dai
    Shuying Cheng
    Xiangjian He
    Neural Computing and Applications, 2018, 29 : 389 - 399
  • [27] Orientation Invariant Feature Embedding and Spatial Temporal Regularization for Vehicle Re-identification
    Wang, Zhongdao
    Tang, Luming
    Liu, Xihui
    Yao, Zhuliang
    Yi, Shuai
    Shao, Jing
    Yan, Junjie
    Wang, Shengjin
    Li, Hongsheng
    Wang, Xiaogang
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 379 - 387
  • [28] VARIATIONAL REPRESENTATION LEARNING FOR VEHICLE RE-IDENTIFICATION
    Alfasly, Saghir Ahmed Saghir
    Hu, Yongjian
    Liang, Tiancai
    Jin, Xiaofeng
    Zhao, Qingli
    Liu, Beibei
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 3118 - 3122
  • [29] Unstructured Feature Decoupling for Vehicle Re-identification
    Qian, Wen
    Luo, Hao
    Peng, Silong
    Wang, Fan
    Chen, Chen
    Li, Hao
    COMPUTER VISION - ECCV 2022, PT XIV, 2022, 13674 : 336 - 353
  • [30] Multi-Stage Spatio-Temporal Aggregation Transformer for Video Person Re-Identification
    Tang, Ziyi
    Zhang, Ruimao
    Peng, Zhanglin
    Chen, Jinrui
    Lin, Liang
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 7917 - 7929