Target-Aware Transformer Tracking

被引:10
|
作者
Zheng, Yuhui [1 ,2 ]
Zhang, Yan [1 ]
Xiao, Bin [3 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Peoples R China
[2] Xidian Univ, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[3] Chongqing Univ Posts & Telecommun, Sch Comp Sci & Technol, Chongqing 400065, Peoples R China
基金
中国国家自然科学基金;
关键词
Transformers; Feature extraction; Correlation; Target tracking; Prediction algorithms; Filtering algorithms; Neural networks; Object tracking; transformer; target-aware module; classification regression network;
D O I
10.1109/TCSVT.2023.3276061
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Object tracking is aimed at locating a specific object in the image sequence, such as pedestrians, vehicles, and so on. The existing algorithms based on siamese neural network predict the target through similarity matching. Although these algorithms have achieved satisfactory performance, in the process of similarity calculation between template image and search image, only local information is often concerned, which makes the algorithms difficult to obtain the optimal solution. To deal with the abovementioned problems, we propose a model based on Transformer, named TaTrack. Specifically, we first use the encoders to enhance the features. Then, the dependency between template features and search features is established through the target-aware module. Finally, we utilize the classification regression network to locate the target, and use the classification score to adapt to update the template image. Experiments show that our model can achieve great performance on GOT-10k, LaSOT, and TrackingNet datasets.
引用
收藏
页码:4542 / 4551
页数:10
相关论文
共 50 条
  • [31] Learning Target-Aware Vision Transformers for Real-Time UAV Tracking
    Li, Shuiwang
    Yang, Xiangyang
    Wang, Xucheng
    Zeng, Dan
    Ye, Hengzhou
    Zhao, Qijun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [32] Target-Aware Molecular Graph Generation
    Tan, Cheng
    Gao, Zhangyang
    Li, Stan Z.
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: APPLIED DATA SCIENCE AND DEMO TRACK, ECML PKDD 2023, PT VI, 2023, 14174 : 410 - 427
  • [33] TARGET-AWARE ANOMALY DETECTION AND DIAGNOSIS
    Borisov, Alexander
    Runger, George
    Tuv, Eugene
    ICINCO 2011: PROCEEDINGS OF THE 8TH INTERNATIONAL CONFERENCE ON INFORMATICS IN CONTROL, AUTOMATION AND ROBOTICS, VOL 1, 2011, : 14 - 23
  • [34] TEFNet: Target-Aware Enhanced Fusion Network for RGB-T Tracking
    Chen, Panfeng
    Gong, Shengrong
    Ying, Wenhao
    Du, Xin
    Zhong, Shan
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT X, 2024, 14434 : 432 - 443
  • [35] Deep Meta Learning for Real-Time Target-Aware Visual Tracking
    Choi, Janghoon
    Kwon, Junseok
    Lee, Kyoung Mu
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 911 - 920
  • [36] SiamATA: an asymmetric target-aware and frequency domain task-aware Siamese network for visual tracking
    Liang, Xingzhu
    Xiao, Yunzhuang
    Lin, Yu-e
    Yan, Xinyun
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024,
  • [37] Target-Aware Siamese Networks Based on Masked Attention Mechanism for Visual Object Tracking
    Su, Yao-Hui
    Shieh, Ming-Der
    Tsai, Chia-Chi
    2024 IEEE 7TH INTERNATIONAL CONFERENCE ON MULTIMEDIA INFORMATION PROCESSING AND RETRIEVAL, MIPR 2024, 2024, : 28 - 34
  • [38] Tracking by Joint Local and Global Search: A Target-Aware Attention-Based Approach
    Wang, Xiao
    Tang, Jin
    Luo, Bin
    Wang, Yaowei
    Tian, Yonghong
    Wu, Feng
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (11) : 6931 - 6945
  • [39] Decision Transformer based Target-aware Feature Selection Network for Behavior-oriented Recommendation
    Li, Tianyang
    Yan, Hongbin
    Xu, Hanwen
    PROCEEDINGS OF THE 2024 27 TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, CSCWD 2024, 2024, : 2430 - 2435
  • [40] Target-Aware Data Augmentation for Stance Detection
    Li, Yingjie
    Caragea, Cornelia
    2021 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL-HLT 2021), 2021, : 1850 - 1860