SiamATA: an asymmetric target-aware and frequency domain task-aware Siamese network for visual tracking

被引:0
|
作者
Liang, Xingzhu [1 ,2 ,3 ]
Xiao, Yunzhuang [1 ]
Lin, Yu-e [1 ]
Yan, Xinyun [4 ]
机构
[1] Anhui Univ Sci & Technol, Sch Comp Sci & Engn, Huainan 232001, Anhui, Peoples R China
[2] Anhui Univ Sci & Technol, Huainan Peoples Hosp 1, Affiliated Hosp 1, Huainan 232007, Anhui, Peoples R China
[3] Anhui Univ Sci & Technol, Inst Environm Friendly Mat & Occupat Hlth, Wuhu 241003, Anhui, Peoples R China
[4] Jinling Inst Technol, Jiangsu AI Transportat Innovat & Applicat Engn Res, Nanjing 211169, Jiangsu, Peoples R China
关键词
Target-aware attention; Task-aware attention; Siamese network; Visual tracking; OBJECT TRACKING;
D O I
10.1007/s13042-024-02394-y
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, Siamese-based trackers have achieved promising results in visual object tracking. However, the feature extraction capability of current popular Siamese-like networks is limited, making it difficult to fully distinguish the object from the background. Trackers are susceptible to drifting caused by factors such as occlusion, scale variation, and fast motion. In this paper, we propose a novel tracker, dubbed Siamese network with asymmetric target-aware and task-aware (SiamATA). The network is based on the asymmetric structure of the classification-regression branches, including the template classification branch, template regression branch, search region classification branch, and search region regression branch, to alleviate overfitting. Meanwhile, a target-aware attention module is introduced to learn powerful context information through spatial attention and selectively emphasize dependency channel features through channel attention, providing target-aware semantic features for each branch. In addition, we adopt the nonlocal pixel-wise correlation method to suppress the influence of similar object interference. Finally, we design a frequency domain task-aware attention module to explore the self-semantic information of classification and regression branches. Extensive experiments demonstrate the effectiveness of our tracker on six benchmarks: OTB100, UAV123, VOT2018, VOT2019, GOT-10K, and LaSOT.
引用
收藏
页数:20
相关论文
共 50 条
  • [41] Target-aware pooling combining global contexts for aerial tracking
    Wu, Yue
    Cai, Chengtao
    Yeo, Chai Kiat
    Wu, Kejun
    VISUAL COMPUTER, 2024, 40 (12): : 8895 - 8905
  • [42] Target-Aware Tracking with Long-Term Context Attention
    He, Kaijie
    Zhang, Canlong
    Xie, Sheng
    Li, Zhixin
    Wang, Zhiwen
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 1, 2023, : 773 - 780
  • [43] Target Aware Visual Object Tracking
    Ozer, Caner
    Gurkan, Filiz
    Gunsel, Bilge
    IMAGE ANALYSIS AND RECOGNITION (ICIAR 2019), PT II, 2019, 11663 : 186 - 198
  • [44] Target-Aware Recurrent Attentional Network for Radar HRRP Target Recognition
    Xu, Bin
    Chen, Bo
    Wan, Jinwei
    Liu, Hongwei
    Pn, Lin
    SIGNAL PROCESSING, 2019, 155 : 268 - 280
  • [45] Task-Aware Meta Learning-Based Siamese Neural Network for Classifying Control Flow Obfuscated Malware
    Zhu, Jinting
    Jang-Jaccard, Julian
    Singh, Amardeep
    Watters, Paul A.
    Camtepe, Seyit
    FUTURE INTERNET, 2023, 15 (06)
  • [46] Hierarchical Task-aware Multi-Head Attention Network
    Du, Jing
    Yao, Lina
    Wang, Xianzhi
    Guo, Bin
    Yu, Zhiwen
    PROCEEDINGS OF THE 45TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '22), 2022, : 1933 - 1937
  • [47] Context-aware Siamese network for object tracking
    Zhang, Jianwei
    Wang, Jingchao
    Zhang, Huanlong
    Miao, Mengen
    Wu, Di
    IET IMAGE PROCESSING, 2023, 17 (01) : 215 - 226
  • [48] SiamOAN: Siamese object-aware network for real-time target tracking
    Wei, Bingbing
    Chen, Hongyu
    Ding, Qinghai
    Luo, Haibo
    NEUROCOMPUTING, 2022, 471 : 161 - 174
  • [49] Self-Supervised Tracking via Target-Aware Data Synthesis
    Li, Xin
    Pei, Wenjie
    Wang, Yaowei
    He, Zhenyu
    Lu, Huchuan
    Yang, Ming-Hsuan
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (07) : 9186 - 9197
  • [50] Know Who You Are: Learning Target-Aware Transformer for Object Tracking
    Zou, Zhuojun
    Liu, Xuexin
    Zhang, Yuanpei
    Shu, Lin
    Hao, Jie
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 1427 - 1432