Target-Aware Transformer Tracking

被引:10
|
作者
Zheng, Yuhui [1 ,2 ]
Zhang, Yan [1 ]
Xiao, Bin [3 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Peoples R China
[2] Xidian Univ, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[3] Chongqing Univ Posts & Telecommun, Sch Comp Sci & Technol, Chongqing 400065, Peoples R China
基金
中国国家自然科学基金;
关键词
Transformers; Feature extraction; Correlation; Target tracking; Prediction algorithms; Filtering algorithms; Neural networks; Object tracking; transformer; target-aware module; classification regression network;
D O I
10.1109/TCSVT.2023.3276061
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Object tracking is aimed at locating a specific object in the image sequence, such as pedestrians, vehicles, and so on. The existing algorithms based on siamese neural network predict the target through similarity matching. Although these algorithms have achieved satisfactory performance, in the process of similarity calculation between template image and search image, only local information is often concerned, which makes the algorithms difficult to obtain the optimal solution. To deal with the abovementioned problems, we propose a model based on Transformer, named TaTrack. Specifically, we first use the encoders to enhance the features. Then, the dependency between template features and search features is established through the target-aware module. Finally, we utilize the classification regression network to locate the target, and use the classification score to adapt to update the template image. Experiments show that our model can achieve great performance on GOT-10k, LaSOT, and TrackingNet datasets.
引用
收藏
页码:4542 / 4551
页数:10
相关论文
共 50 条
  • [41] Target-Aware Fusion of Infrared and Visible Images
    Zhou, Yingjie
    Gao, Kun
    Dou, Zeyang
    Hua, Zizheng
    Wang, Hong
    IEEE ACCESS, 2018, 6 : 79039 - 79049
  • [42] CRAXfuzz: Target-Aware Symbolic Fuzz Testing
    Yeh, Chao-Chun
    Chung, Hsiang
    Huang, Shih-Kun
    39TH ANNUAL IEEE COMPUTERS, SOFTWARE AND APPLICATIONS CONFERENCE (COMPSAC 2015), VOL 2, 2015, : 460 - 471
  • [43] Target-aware Lattice Rescoring for Dialect Recognition
    Tong, Rong
    Ma, Bin
    Li, Haizhou
    Chng, Eng Siong
    12TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2011 (INTERSPEECH 2011), VOLS 1-5, 2011, : 740 - +
  • [44] Target-aware for Few-shot Segmentation
    Luo, XiaoLiu
    Zhang, Taiping
    Duan, Zhao
    Tan, Jin
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [45] Target-Aware Language Models for Spoken Language Recognition
    Tong, Rong
    Ma, Bin
    Li, Haizhou
    Chang, Eng Siong
    Lee, Kong-Aik
    INTERSPEECH 2009: 10TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2009, VOLS 1-5, 2009, : 200 - +
  • [46] Target-Aware Implicit Mapping for Agricultural Crop Inspection
    Kelly, Shane
    Riccardi, Alessandro
    Marks, Elias
    Magistri, Federico
    Guadagnino, Tiziano
    Chli, Margarita
    Stachniss, Cyrill
    2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2023), 2023, : 9608 - 9614
  • [47] A Target-Aware Fusion Framework for Infrared and Visible Images
    Zhang, Yingmei
    Lee, Hyo Jong
    IEEE ACCESS, 2023, 11 : 33666 - 33681
  • [48] Target-Aware Recurrent Attentional Network for Radar HRRP Target Recognition
    Xu, Bin
    Chen, Bo
    Wan, Jinwei
    Liu, Hongwei
    Pn, Lin
    SIGNAL PROCESSING, 2019, 155 : 268 - 280
  • [49] Knowledge Enhanced Target-Aware Stance Detection on Tweets
    Zhang, Xin
    Yuan, Jianhua
    Zhao, Yanyan
    Qin, Bing
    KNOWLEDGE GRAPH AND SEMANTIC COMPUTING: KNOWLEDGE GRAPH EMPOWERS NEW INFRASTRUCTURE CONSTRUCTION, 2021, 1466 : 171 - 184
  • [50] Target-Aware Neural Architecture Search and Deployment for Keyword Spotting
    Busia, Paola
    Deriu, Gianfranco
    Rinelli, Luca
    Chesta, Cristina
    Raffo, Luigi
    Meloni, Paolo
    IEEE ACCESS, 2022, 10 : 40687 - 40700