Multi-Object Tracking With Separation in Deep Space

被引:0
|
作者
Hu, Mengjie [1 ]
Wang, Haotian [1 ]
Wang, Hao [2 ]
Li, Binyu [2 ]
Cao, Shixiang [2 ]
Zhan, Tao [1 ]
Zhu, Xiaotong [3 ]
Liu, Tianqi [4 ]
Liu, Chun [1 ]
Song, Qing [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Intelligent Engn & Automat, Beijing 100876, Peoples R China
[2] Beijing Inst Space Mech & Elect, Beijing 100094, Peoples R China
[3] Beihang Univ, State Key Lab Complex & Crit Software Environm, Beijing 100191, Peoples R China
[4] Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China
关键词
Trajectory; Tracking; Deep-space communications; Videos; Transformers; Predictive models; Kalman filters; Feature extraction; Deep learning; Satellites; Deep space; graph network; multi-object tracking (MOT); object separation; position encoding; transformer encoder; FILTER;
D O I
10.1109/TGRS.2024.3522290
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
In deep space environment, some objects may split into several small fragments during movement, and these deep space objects often appear as points in satellite images. In this article, we conduct research on multi-object tracking (MOT) for these objects. First, we propose a simulation dataset, ScatterDataset, which simulates the movement and separation of objects in deep space background. By assigning two IDs to a trajectory, we describe the trajectory's relationship before and after separation. Second, we present an end-to-end motion association model, ScatterNet, which encodes the position information of trajectories and detections into motion features. These features are processed through temporal aggregation by a Transformer encoder and spatial aggregation by a graph network; then, we get the association results by calculating the similarity between these features. Finally, we introduce a tracker, ScatterTracker, which is suitable for tracking in scenarios with object separation. Experiments with state-of-the-art tracking methods on ScatterDataset demonstrate that our approach has achieved significant performance improvements in deep space scenarios. The code is available at: https://github.com/wht-bupt/ScatterTrack.
引用
收藏
页数:20
相关论文
共 50 条
  • [1] Deep Network Flow for Multi-Object Tracking
    Schulter, Samuel
    Vernaza, Paul
    Choi, Wongun
    Chandraker, Manmohan
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 2730 - 2739
  • [2] Collaborative Deep Reinforcement Learning for Multi-object Tracking
    Ren, Liangliang
    Lu, Jiwen
    Wang, Zifeng
    Tian, Qi
    Zhou, Jie
    COMPUTER VISION - ECCV 2018, PT III, 2018, 11207 : 605 - 621
  • [3] Review of Multi-Object Tracking Based on Deep Learning
    Li, Jiaxin
    Zhao, Lei
    Zheng, Zhaohuang
    Yong, Ting
    2022 ASIA CONFERENCE ON ALGORITHMS, COMPUTING AND MACHINE LEARNING (CACML 2022), 2022, : 719 - 725
  • [4] Online Multi-object Tracking Based on Deep Learning
    Sun, Zheming
    Bo, Chunjuan
    Wang, Dong
    COMMUNICATIONS, SIGNAL PROCESSING, AND SYSTEMS, VOL. 1, 2022, 878 : 33 - 40
  • [5] Deep learning in video multi-object tracking: A survey
    Ciaparrone, Gioele
    Luque Sanchez, Francisco
    Tabik, Siham
    Troiano, Luigi
    Tagliaferri, Roberto
    Herrera, Francisco
    NEUROCOMPUTING, 2020, 381 : 61 - 88
  • [6] A multi-object tracking indoor positioning system for Smart Space
    Gu, Hong-Liang
    Shi, Yuan-Chun
    Shen, Rui-Min
    Chen, Yu
    Jisuanji Xuebao/Chinese Journal of Computers, 2007, 30 (09): : 1603 - 1611
  • [7] Deep learning in multi-object detection and tracking: state of the art
    Pal, Sankar K.
    Pramanik, Anima
    Maiti, J.
    Mitra, Pabitra
    APPLIED INTELLIGENCE, 2021, 51 (09) : 6400 - 6429
  • [8] AttTrack: Online Deep Attention Transfer for Multi-object Tracking
    Nalaie, Keivan
    Zheng, Rong
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 1654 - 1663
  • [9] Robust multi-object tracking using deep learning framework
    Pang, Sh Ch
    Du, Anan
    Yu, Zh. Zh.
    JOURNAL OF OPTICAL TECHNOLOGY, 2015, 82 (08) : 516 - 527
  • [10] Deep learning in multi-object detection and tracking: state of the art
    Sankar K. Pal
    Anima Pramanik
    J. Maiti
    Pabitra Mitra
    Applied Intelligence, 2021, 51 : 6400 - 6429