Multi-Task Probabilistic Regression With Overlap Maximization for Visual Tracking

被引:0
|
作者
Feng, Zihang [1 ]
Yan, Liping [1 ]
Xia, Yuanqing [1 ]
Xiao, Bo [2 ]
机构
[1] Beijing Inst Technol, Sch Automat, Key Lab Intelligent Control & Decis Complex Syst, Beijing 100081, Peoples R China
[2] Beijing Univ Posts & Telecommun, Sch Artificial Intelligence, Beijing 100876, Peoples R China
关键词
Visual tracking; Siamese network; probabilistic regression; overlap maximization; OBJECT TRACKING; NETWORK;
D O I
10.1109/TCSVT.2023.3275573
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recent researches made a breakthrough in visual tracking accuracy. Many trackers benefit from the object state representations and network loss functions, which mine the output space and improve the power of supervision, respectively. Probabilistic regression method models the noises and uncertainties in the annotations. However, advanced trackers with probabilistic regression are not studied sufficiently in the aspect of supervision and the aspect of robustness of evaluation maximization. In this paper, an overlap maximization network in the manner of probabilistic regression is proposed to improve the learning ability of the network and the discriminative ability in the evaluation maximization. Firstly, the probabilistic regression is extended with the intersection over union (IoU) evaluation, which is normalized as a probability density in the regression space. Secondly, the classification probability is added as a branch of the iterative evaluation module to improve the ability of distinguishing objects in the evaluation maximization. Moreover, the two branches are constructed into a joint probabilistic regression task of IoU evaluation, which makes the network learn from two types of ground truth and provide a consistent result with multi-branch outputs. For feature interpretation, the strip pooling network and the space-time memory network are introduced to encode long-range context and provide dynamic features, respectively. Compared to the state-of-the-art probabilistic regression trackers and other advanced trackers, the experiments show that the proposed tracker achieves outstanding performance across the six datasets, including GOT-10k, LaSOT, TrackingNet, UAV123, OTB-100 and VOT2018.
引用
收藏
页码:7554 / 7564
页数:11
相关论文
共 50 条
  • [1] DENSETRACKER: A MULTI-TASK DENSE NETWORK FOR VISUAL TRACKING
    Zhao, Fei
    Tang, Ming
    Wu, Yi
    Wang, Jinqiao
    2017 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2017, : 607 - 612
  • [2] Probabilistic Multi-Task Learning for Visual Saliency Estimation in Video
    Li, Jia
    Tian, Yonghong
    Huang, Tiejun
    Gao, Wen
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2010, 90 (02) : 150 - 165
  • [3] Probabilistic Multi-Task Learning for Visual Saliency Estimation in Video
    Jia Li
    Yonghong Tian
    Tiejun Huang
    Wen Gao
    International Journal of Computer Vision, 2010, 90 : 150 - 165
  • [4] Multi-Task Deep Dual Correlation Filters for Visual Tracking
    Zheng, Yuhui
    Liu, Xinyan
    Cheng, Xu
    Zhang, Kaihua
    Wu, Yi
    Chen, Shengyong
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 9614 - 9626
  • [5] Robust Visual Tracking via Multi-Task Sparse Learning
    Zhang, Tianzhu
    Ghanem, Bernard
    Liu, Si
    Ahuja, Narendra
    2012 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2012, : 2042 - 2049
  • [6] Multi-Task Convolution Operators With Object Detection for Visual Tracking
    Zheng, Yuhui
    Liu, Xinyan
    Xiao, Bin
    Cheng, Xu
    Wu, Yi
    Chen, Shengyong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (12) : 8204 - 8216
  • [7] Learning Multi-Task Correlation Particle Filters for Visual Tracking
    Zhang, Tianzhu
    Xu, Changsheng
    Yang, Ming-Hsuan
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (02) : 365 - 378
  • [8] Probabilistic Regression for Visual Tracking
    Danelljan, Martin
    Van Gool, Luc
    Timofte, Radu
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 7181 - 7190
  • [9] Object Tracking via Multi-Task Gaussian-Laplacian Regression
    Gao, Yicheng
    Yang, Jian
    Wang, Huan
    Bai, Hongyang
    2013 SECOND IAPR ASIAN CONFERENCE ON PATTERN RECOGNITION (ACPR 2013), 2013, : 405 - 409
  • [10] Multi-Task Learning for Influence Estimation and Maximization
    Panagopoulos, George
    Malliaros, Fragkiskos D.
    Vazirgiannis, Michalis
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2022, 34 (09) : 4398 - 4409