SiamHAS: Siamese Tracker with Hierarchical Attention Strategy for Aerial Tracking

被引:5
|
作者
Liu, Faxue [1 ,2 ]
Liu, Jinghong [1 ,2 ]
Chen, Qiqi [1 ,2 ]
Wang, Xuan [1 ]
Liu, Chenglong [1 ]
机构
[1] Chinese Acad Sci, Changchun Inst Opt Fine Mech & Phys CIOMP, Changchun 130033, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
基金
中国国家自然科学基金;
关键词
Siamese tracker; deep learning; hierarchical attention strategy; multi-level feature enhancement; OBJECTS; ROBUST;
D O I
10.3390/mi14040893
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
For the Siamese network-based trackers utilizing modern deep feature extraction networks without taking full advantage of the different levels of features, tracking drift is prone to occur in aerial scenarios, such as target occlusion, scale variation, and low-resolution target tracking. Additionally, the accuracy is low in challenging scenarios of visual tracking, which is due to the imperfect utilization of features. To improve the performance of the existing Siamese tracker in the above-mentioned challenging scenes, we propose a Siamese tracker based on Transformer multi-level feature enhancement with a hierarchical attention strategy. The saliency of the extracted features is enhanced by the process of Transformer Multi-level Enhancement; the application of the hierarchical attention strategy makes the tracker adaptively notice the target region information and improve the tracking performance in challenging aerial scenarios. Meanwhile, we conducted extensive experiments and qualitative or quantitative discussions on UVA123, UAV20L, and OTB100 datasets. Finally, the experimental results show that our SiamHAS performs favorably against several state-of-the-art trackers in these challenging scenarios.
引用
收藏
页数:26
相关论文
共 50 条
  • [1] Visual Object Tracking by Hierarchical Attention Siamese Network
    Shen, Jianbing
    Tang, Xin
    Dong, Xingping
    Shao, Ling
    IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (07) : 3068 - 3080
  • [2] Hierarchical Attention Siamese Network for Thermal Infrared Target Tracking
    Yuan, Di
    Liao, Donghai
    Huang, Feng
    Qiu, Zhaobing
    Shu, Xiu
    Tian, Chunwei
    Liu, Qiao
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73
  • [3] SiamSTA: Spatio-Temporal Attention based Siamese Tracker for Tracking UAVs
    Huang, Bo
    Chen, Junjie
    Xu, Tingfa
    Wang, Ying
    Jiang, Shenwang
    Wang, Yuncheng
    Wang, Lei
    Li, Jianan
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, : 1204 - 1212
  • [4] Multi-granularity Hierarchical Attention Siamese Network for Visual Tracking
    Chen, Xing
    Zhang, Xiang
    Tan, Huibin
    Lan, Long
    Luo, Zhigang
    Huang, Xuhui
    2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018,
  • [5] Attention Template Update Model for Siamese Tracker
    Jia, Fengshou
    Tang, Zhao
    Gao, Yun
    PATTERN RECOGNITION AND COMPUTER VISION, PT I, 2021, 13019 : 229 - 241
  • [6] Siamese Network Tracker with Channel Attention Mechanism
    Zhang Sen
    Gao Yun
    THIRTEENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING (ICGIP 2021), 2022, 12083
  • [7] Integrated Channel Attention Method for Siamese Tracker
    Zhou, Ziyi
    Jin, Yingran
    Gao, Yun
    SIXTEENTH INTERNATIONAL CONFERENCE ON MACHINE VISION, ICMV 2023, 2024, 13072
  • [8] SiamHSFT: A Siamese Network-Based Tracker with Hierarchical Sparse Fusion and Transformer for UAV Tracking
    Hu, Xiuhua
    Zhao, Jing
    Hui, Yan
    Li, Shuang
    You, Shijie
    SENSORS, 2023, 23 (21)
  • [9] Light-Weight Siamese Attention Network Object Tracking for Unmanned Aerial Vehicle
    Cui Zhoujuan
    An Junshe
    Zhang Yufeng
    Cui Tianshu
    ACTA OPTICA SINICA, 2020, 40 (19)
  • [10] Siamese Natural Language Tracker: Tracking by Natural Language Descriptions with Siamese Trackers
    Feng, Qi
    Ablavsky, Vitaly
    Bai, Qinxun
    Sclaroff, Stan
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 5847 - 5856