Analysis of Recent Re-Identification Architectures for Tracking-by-Detection Paradigm in Multi-Object Tracking

被引:0
|
作者
Ishikawa, Haruya [1 ]
Hayashi, Masaki [1 ]
Phan, Trong [2 ]
Yamamoto, Kazuma [2 ]
Masuda, Makoto [2 ]
Aoki, Yoshimitsu [1 ]
机构
[1] Keio Univ, Dept Elect Engn, Yokohama, Kanagawa, Japan
[2] OKI Elect Ind Co Ltd, Saitama, Japan
关键词
Multi-Object Tracking; Person Re-Identification; Video Re-Identification; Metric Learning;
D O I
10.5220/0010341502340244
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Person re-identification is a vital module of the tracking-by-detection framework for online multi-object tracking. Despite recent advances in multi-object tracking and person re-identification, inadequate attention was given to integrating these technologies to provide a robust multi-object tracker. In this work, we combine modern state-of-the-art re-identification models and modeling techniques on the basic tracking-by-detection framework and benchmark them on heavily occluded scenes to understand their effect. We hypothesize that temporal modeling for re-identification is crucial for training robust re-identification models for they are conditioned on sequences containing occlusions. Along with traditional image-based re-identification methods, we analyze temporal modeling methods used in video-based re-identification tasks. We also train re-identification models with different embedding methods, including triplet loss, and analyze their effect. We benchmark the re-identification models on the challenging MOT20 dataset containing crowded scenes with various occlusions. We provide a thorough assessment and investigation of the usage of modern re-identification modeling methods and prove that these methods are, in fact, effective for multi-object tracking. Compared to baseline methods, results show that these models can provide robust re-identification proved by improvements in the number of identity switching, MOTA, IDF1, and other metrics.
引用
收藏
页码:234 / 244
页数:11
相关论文
共 50 条
  • [1] A METHOD FOR JOINT DETECTION AND RE-IDENTIFICATION IN MULTI-OBJECT TRACKING
    Huang, L.
    Shi, X.
    Xiang, J.
    NEURAL NETWORK WORLD, 2022, 32 (06) : 285 - 300
  • [2] Joint Re-Detection and Re-Identification for Multi-Object Tracking
    He, Jian
    Zhong, Xian
    Yuan, Jingling
    Tan, Ming
    Zhao, Shilei
    Zhong, Luo
    MULTIMEDIA MODELING (MMM 2022), PT I, 2022, 13141 : 364 - 376
  • [3] JOINT DETECTION, RE-IDENTIFICATION, AND LSTM IN MULTI-OBJECT TRACKING
    Tsai, Wen-Jiin
    Huang, Zih-Jie
    Chung, Chen-En
    2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2020,
  • [4] A Closer Look at the Joint Training of Object Detection and Re-Identification in Multi-Object Tracking
    Liang, Tianyi
    Li, Baopu
    Wang, Mengzhu
    Tan, Huibin
    Luo, Zhigang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 267 - 280
  • [5] A Simple but Effective Method for Balancing Detection and Re-Identification in Multi-Object Tracking
    Yang, Pan
    Luo, Xiong
    Sun, Jiankun
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 7456 - 7468
  • [6] Multi-cue multi-hypothesis tracking with re-identification for multi-object tracking
    Guo, Wen
    Jin, Yuelong
    Shan, Bin
    Ding, Xinmiao
    Wang, Minghao
    MULTIMEDIA SYSTEMS, 2022, 28 (03) : 925 - 937
  • [7] Re-Identification for Multi-Object Tracking Using Triplet Loss
    Ko, Koung-Suk
    Ahn, Woo-Jin
    Kim, Geon-Hee
    Lim, Myo-Taeg
    Kang, Tae-Koo
    Pae, Dong-Sung
    35TH INTERNATIONAL CONFERENCE ON INFORMATION NETWORKING (ICOIN 2021), 2021, : 525 - 527
  • [8] Multi-cue multi-hypothesis tracking with re-identification for multi-object tracking
    Wen Guo
    Yuelong Jin
    Bin Shan
    Xinmiao Ding
    Minghao Wang
    Multimedia Systems, 2022, 28 : 925 - 937
  • [9] Multi-Object Tracking Based on Re-Identification Enhancement and Associated Correction
    Li, Jiayue
    Piao, Yan
    APPLIED SCIENCES-BASEL, 2023, 13 (17):
  • [10] Online multi-object tracking with pedestrian re-identification and occlusion processing
    Zhang, Xueqin
    Wang, Xiaoxiao
    Gu, Chunhua
    VISUAL COMPUTER, 2021, 37 (05): : 1089 - 1099