Single Object Tracking in Satellite Videos Based on Feature Enhancement and Multi-Level Matching Strategy

被引:7
|
作者
Yang, Jianwei [1 ,2 ,3 ]
Pan, Zongxu [1 ,2 ,3 ]
Liu, Yuhan [1 ,2 ]
Niu, Ben [1 ,2 ,3 ]
Lei, Bin [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100094, Peoples R China
[2] Chinese Acad Sci, Key Lab Technol Geospatial Informat Proc & Applica, Beijing 100190, Peoples R China
[3] Univ Chinese Acad Sci, Sch Elect Elect & Commun Engn, Beijing 100049, Peoples R China
关键词
satellite video; object tracking; siamese network; feature enhancement; matching strategy; SIAMESE NETWORKS;
D O I
10.3390/rs15174351
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Despite significant advancements in remote sensing object tracking (RSOT) in recent years, achieving accurate and continuous tracking of tiny-sized targets remains a challenging task due to similar object interference and other related issues. In this paper, from the perspective of feature enhancement and a better feature matching strategy, we present a tracker SiamTM specifically designed for RSOT, which is mainly based on a new target information enhancement (TIE) module and a multi-level matching strategy. First, we propose a TIE module to address the challenge of tiny object sizes in satellite videos. The proposed TIE module goes along two spatial directions to capture orientation and position-aware information, respectively, while capturing inter-channel information at the global 2D image level. The TIE module enables the network to extract discriminative features of the targets more effectively from satellite images. Furthermore, we introduce a multi-level matching (MM) module that is better suited for satellite video targets. The MM module firstly embeds the target feature map after ROI Align into each position of the search region feature map to obtain a preliminary response map. Subsequently, the preliminary response map and the template region feature map are subjected to the Depth-wise Cross Correlation operation to get a more refined response map. Through this coarse-to-fine approach, the tracker obtains a response map with a more accurate position, which lays a good foundation for the prediction operation of the subsequent sub-networks. We conducted extensive experiments on two large satellite video single-object tracking datasets: SatSOT and SV248S. Without bells and whistles, the proposed tracker SiamTM achieved competitive results on both datasets while running at real-time speed.
引用
收藏
页数:25
相关论文
共 50 条
  • [1] Multi-level temporal feature fusion with feature exchange strategy for multiple object tracking
    Ge, Yisu
    Ye, Wenjie
    Zhang, Guodao
    Lin, Mengying
    OPTOELECTRONICS LETTERS, 2024, 20 (08) : 505 - 512
  • [2] LocaLock: Enhancing Multi-Object Tracking in Satellite Videos via Local Feature Matching
    Kong, Lingyu
    Yan, Zhiyuan
    Shi, Hanru
    Zhang, Ting
    Wang, Lei
    REMOTE SENSING, 2025, 17 (03)
  • [3] Multi-level temporal feature fusion with feature exchange strategy for multiple object tracking
    GE Yisu
    YE Wenjie
    ZHANG Guodao
    LIN Mengying
    Optoelectronics Letters, 2024, 20 (08) : 505 - 512
  • [4] Deep feature based correlation filter for single object tracking in satellite videos
    Sharma, Devendra
    Srivastava, Rajeev
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (8-9) : 6443 - 6454
  • [5] Triplet Network with Multi-level Feature Fusion for Object Tracking
    Cao, Yang
    Wan, Bo
    Wang, Quan
    Cheng, Fei
    2020 JOINT 9TH INTERNATIONAL CONFERENCE ON INFORMATICS, ELECTRONICS & VISION (ICIEV) AND 2020 4TH INTERNATIONAL CONFERENCE ON IMAGING, VISION & PATTERN RECOGNITION (ICIVPR), 2020,
  • [6] Multi-Object Tracking Algorithm Based on Feature Enhancement in Optical Remote Sensing Videos
    Liu, Chen
    Chen, Shi
    Chen, Hongzhen
    Computer Engineering and Applications, 61 (03): : 177 - 185
  • [7] Multi-level feature enhancement network for object detection in sonar images
    Zhou, Xin
    Zhou, Zihan
    Wang, Manying
    Ning, Bo
    Wang, Yanhao
    Zhu, Pengli
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 100
  • [8] Object Tracking in Satellite Videos Based on Correlation Filter with Multi-Feature Fusion and Motion Trajectory Compensation
    Liu, Yaosheng
    Liao, Yurong
    Lin, Cunbao
    Jia, Yutong
    Li, Zhaoming
    Yang, Xinyan
    REMOTE SENSING, 2022, 14 (03)
  • [9] High-Precision Multi-Object Tracking in Satellite Videos via Pixel-Wise Adaptive Feature Enhancement
    Wan, Gang
    Su, Zhijuan
    Wu, Yitian
    Guo, Ningbo
    Cong, Dianwei
    Wei, Zhanji
    Liu, Wei
    Wang, Guoping
    SENSORS, 2024, 24 (19)
  • [10] A Virtual Keyboard System Based on Multi-Level Feature Matching
    Du, Huan
    Charbon, Edoardo
    2008 CONFERENCE ON HUMAN SYSTEM INTERACTIONS, VOLS 1 AND 2, 2008, : 170 - 175