Single Object Tracking in Satellite Videos Based on Feature Enhancement and Multi-Level Matching Strategy

被引:7
|
作者
Yang, Jianwei [1 ,2 ,3 ]
Pan, Zongxu [1 ,2 ,3 ]
Liu, Yuhan [1 ,2 ]
Niu, Ben [1 ,2 ,3 ]
Lei, Bin [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100094, Peoples R China
[2] Chinese Acad Sci, Key Lab Technol Geospatial Informat Proc & Applica, Beijing 100190, Peoples R China
[3] Univ Chinese Acad Sci, Sch Elect Elect & Commun Engn, Beijing 100049, Peoples R China
关键词
satellite video; object tracking; siamese network; feature enhancement; matching strategy; SIAMESE NETWORKS;
D O I
10.3390/rs15174351
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Despite significant advancements in remote sensing object tracking (RSOT) in recent years, achieving accurate and continuous tracking of tiny-sized targets remains a challenging task due to similar object interference and other related issues. In this paper, from the perspective of feature enhancement and a better feature matching strategy, we present a tracker SiamTM specifically designed for RSOT, which is mainly based on a new target information enhancement (TIE) module and a multi-level matching strategy. First, we propose a TIE module to address the challenge of tiny object sizes in satellite videos. The proposed TIE module goes along two spatial directions to capture orientation and position-aware information, respectively, while capturing inter-channel information at the global 2D image level. The TIE module enables the network to extract discriminative features of the targets more effectively from satellite images. Furthermore, we introduce a multi-level matching (MM) module that is better suited for satellite video targets. The MM module firstly embeds the target feature map after ROI Align into each position of the search region feature map to obtain a preliminary response map. Subsequently, the preliminary response map and the template region feature map are subjected to the Depth-wise Cross Correlation operation to get a more refined response map. Through this coarse-to-fine approach, the tracker obtains a response map with a more accurate position, which lays a good foundation for the prediction operation of the subsequent sub-networks. We conducted extensive experiments on two large satellite video single-object tracking datasets: SatSOT and SV248S. Without bells and whistles, the proposed tracker SiamTM achieved competitive results on both datasets while running at real-time speed.
引用
收藏
页数:25
相关论文
共 50 条
  • [41] A Multi-level Feature Extraction Method for Heterogeneous Sample Enhancement
    Ren, Yifu
    Zhai, Lizhi
    Bai, Jie
    Gao, Xuepan
    Lu, Yuliang
    2023 2ND CONFERENCE ON FULLY ACTUATED SYSTEM THEORY AND APPLICATIONS, CFASTA, 2023, : 497 - 501
  • [42] A Multi-level Feature Enhancement Network for Image Splicing Localization
    Zhang, Zeyu
    Cao, Yun
    Zhao, Xianfeng
    DIGITAL FORENSICS AND WATERMARKING, IWDW 2021, 2022, 13180 : 3 - 16
  • [43] Multi-level loss object tracking adversarial attack method based on spatial perception
    Cheng X.
    Wang Y.
    Zhang N.
    Fu Z.
    Chen B.
    Zhao G.
    Tongxin Xuebao/Journal on Communications, 2021, 42 (11): : 242 - 254
  • [44] Multi-level structural deformation estimation by vision-based object boundary tracking
    Ren C.
    Shan J.
    Liu Y.
    Wu H.
    Zhou D.
    Tumu Gongcheng Xuebao/China Civil Engineering Journal, 2023, 56 (10): : 11 - 19
  • [45] M2Det: A Single-Shot Object Detector Based on Multi-Level Feature Pyramid Network
    Zhao, Qijie
    Sheng, Tao
    Wang, Yongtao
    Tang, Zhi
    Chen, Ying
    Cai, Ling
    Ling, Haibin
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 9259 - 9266
  • [46] Single Object Tracking in Satellite Videos: A Correlation Filter-Based Dual-Flow Tracker
    Chen, Yuzeng
    Tang, Yuqi
    Yin, Zhiyong
    Han, Te
    Zou, Bin
    Feng, Huihui
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 6687 - 6698
  • [47] Multi-Object Tracking in Video Sequences Based on Background Subtraction and SIFT Feature Matching
    Rahman, Md. Saidur
    Saha, Aparna
    Khanum, Snigdha
    ICCIT: 2009 FOURTH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCES AND CONVERGENCE INFORMATION TECHNOLOGY, VOLS 1 AND 2, 2009, : 457 - 462
  • [48] RSF-SSD: An Improved SSD Algorithm Based on Multi-level Feature Enhancement
    Yang, Weiqiang
    Zeng, Shan
    Liu, Chaoxian
    Li, Hao
    Kang, Zhen
    ADVANCES IN BRAIN INSPIRED COGNITIVE SYSTEMS, BICS 2023, 2024, 14374 : 123 - 132
  • [49] Pedestrian multi-object tracking algorithm based on improved YOLOX and multi-level data association
    Han K.
    Peng J.
    Journal of Railway Science and Engineering, 2024, 21 (01) : 94 - 105
  • [50] Multi-camera Target Relay Tracking Strategy Based on Multi-subblock Feature Matching
    Chang, Faliang
    Zhang, Guoqiang
    Zhang, Panpan
    Li, Jiangbao
    2010 8TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA), 2010, : 6229 - 6233