Learning Adaptive Target-and-Surrounding Soft Mask for Correlation Filter Based Visual Tracking

被引:6
|
作者
Zhang, Ke [1 ]
Wang, Wuwei [1 ]
Wang, Jingyu [2 ]
Wang, Qi [3 ]
Li, Xuelong [3 ]
机构
[1] Northwestern Polytech Univ, Sch Astronaut, Natl Key Lab Aerosp Flight Dynam, Xian 710072, Peoples R China
[2] Northwestern Polytech Univ, Sch Astronaut, Sch Artificial Intelligence Opt & Elect iOPEN, Xian 710072, Peoples R China
[3] Northwestern Polytech Univ, Sch Artificial Intelligence Opt & Elect iOPEN, Xian 710072, Peoples R China
关键词
Target tracking; Reliability; Visualization; Correlation; Feature extraction; Adaptation models; Training; Visual tracking; discriminative correlation filters; soft mask; target and surrounding; video processing;
D O I
10.1109/TCSVT.2021.3108176
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Visual tracking is a very critical issue in computer vision and video processing. For Discriminative Correlation Filter (DCF)-based tracking methods, it is very essential and meaningful to adaptively incorporate reliable target and surrounding information from video frames. However, most existing DCF-based trackers solely rely on pre-defined and fixed constraints such as a binary mask or quadratic function-based regularization to improve the discrimination. Unfortunately, such attempts fail to adjust the constraints according to the change of tracking circumstance in the video sequence, and thus lead to the lack of reliability of learned filters. To mitigate these problems, we present a novel DCF-based tracking method that introduces an adaptive target-and-surrounding soft mask (ATSM) into the learning formula. The adaptive soft mask that is represented by float numbers contains the detail information for both target region and its surrounding information: first, for the background area, it introduces meaningful background information and suppressing uninformative one; second, for the target area inside the bounding box, it helps to focus on the reliable area and repress the rapidly changing area; third, the target-and-surrounding soft mask is adaptively adjusted based on the variations of the target and its surrounding during the tracking process. By jointly modeling the filter and the adaptive soft mask, our ATSM tracker achieves an efficient integration of meaningful information of both foreground and background and performs favorably against state-of-the-art algorithms on seven well-known benchmarks.
引用
收藏
页码:3708 / 3721
页数:14
相关论文
共 50 条
  • [1] SOFT MASK CORRELATION FILTER FOR VISUAL OBJECT TRACKING
    Huo, Yang
    Wang, Yuehuan
    Yan, Xiaoyun
    Dai, Kaiheng
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 2705 - 2709
  • [2] Learning Target-Adaptive Correlation Filters for Visual Tracking
    She, Y.
    Yi, Y.
    Gu, J.
    COMPUTER GRAPHICS FORUM, 2020, 39 (07) : 387 - 397
  • [3] Visual Tracking Based on Adaptive Spatially Regularized Correlation Filter
    Qian, Cheng
    Zhou, Guiping
    Li, Chunguang
    Xu, Yuming
    2017 IEEE INTERNATIONAL CONFERENCE ON SMART CLOUD (SMARTCLOUD), 2017, : 273 - 277
  • [4] Accurate mask-based spatially regularized correlation filter for visual tracking
    Gu, Xiaodong
    Xu, Xinping
    JOURNAL OF ELECTRONIC IMAGING, 2017, 26 (01)
  • [5] Adaptive Increment Correlation Filter for Visual Tracking
    Chen, Gang
    Fang, Zhiwen
    Yue, Zhou
    Liu, Bo
    Xiao, Yang
    Li, Yanan
    MIPPR 2019: PATTERN RECOGNITION AND COMPUTER VISION, 2020, 11430
  • [6] Target Tracking Based on Collaborative Learning Kernelized Correlation Filter
    Sun, Bin
    Li, Chaofeng
    Zeng, Liling
    Sang, Qingbing
    2018 INTERNATIONAL SYMPOSIUM IN SENSING AND INSTRUMENTATION IN IOT ERA (ISSI), 2018,
  • [7] Target Tracking for Visual Servoing Systems Based on an Adaptive Kalman Filter
    Liu, Chang
    Huang, Xinhan
    Wang, Min
    INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2012, 9
  • [8] Infrared target tracking with correlation filter based on adaptive fusion of responses
    Fang S.
    Gu X.
    Gu X.
    Hongwai yu Jiguang Gongcheng/Infrared and Laser Engineering, 2019, 48 (06):
  • [9] Robust Visual Tracking Based on Adaptive Extraction and Enhancement of Correlation Filter
    Wang, Wuwei
    Zhang, Ke
    Lv, Meibo
    IEEE ACCESS, 2019, 7 : 3534 - 3546
  • [10] Attentional Correlation Filter Network for Adaptive Visual Tracking
    Choi, Jongwon
    Chang, Hyung Jin
    Yun, Sangdoo
    Fischer, Tobias
    Demiris, Yiannis
    Choi, Jin Young
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 4828 - 4837