TrackingMamba: Visual State Space Model for Object Tracking

被引:2
|
作者
Wang, Qingwang [1 ,2 ]
Zhou, Liyao [1 ,2 ]
Jin, Pengcheng [1 ,2 ]
Xin, Qu [1 ,2 ]
Zhong, Hangwei [1 ,2 ]
Song, Haochen [1 ,2 ]
Shen, Tao [1 ,2 ]
机构
[1] Kunming Univ Sci & Technol, Fac Informat Engn & Automat, Kunming 650500, Peoples R China
[2] Kunming Univ Sci & Technol, Yunnan Key Lab Comp Technol Applicat, Kunming 650500, Peoples R China
基金
中国国家自然科学基金;
关键词
Object tracking; Autonomous aerial vehicles; Transformers; Feature extraction; Computational modeling; Accuracy; Visualization; Jungle scenes; Mamba; object tracking; UAV remote sensing;
D O I
10.1109/JSTARS.2024.3458938
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In recent years, UAV object tracking has provided technical support across various fields. Most existing work relies on convolutional neural networks (CNNs) or visual transformers. However, CNNs have limited receptive fields, resulting in suboptimal performance, while transformers require substantial computational resources, making training and inference challenging. Mountainous and jungle environments-critical components of the Earth's surface and key scenarios for UAV object tracking-present unique challenges due to steep terrain, dense vegetation, and rapidly changing weather conditions, which complicate UAV tracking. The lack of relevant datasets further reduces tracking accuracy. This article introduces a new tracking framework based on a state-space model called TrackingMamba, which uses a single-stream tracking architecture with Vision Mamba as its backbone. TrackingMamba not only matches transformer-based trackers in global feature extraction and long-range dependence modeling but also maintains computational efficiency with linear growth. Compared to other advanced trackers, TrackingMamba delivers higher accuracy with a simpler model framework, fewer parameters, and reduced FLOPs. Specifically, on the UAV123 benchmark, TrackingMamba outperforms the baseline model OSTtrack-256, improving AUC by 2.59% and Precision by 4.42%, while reducing parameters by 95.52% and FLOPs by 95.02%. The article also evaluates the performance and shortcomings of TrackingMamba and other advanced trackers in the complex and critical context of jungle environments, and it explores potential future research directions in UAV jungle object tracking.
引用
收藏
页码:16744 / 16754
页数:11
相关论文
共 50 条
  • [41] Filtering in a unit quaternion space for model-based object tracking
    Ude, A
    INTELLIGENT AUTONOMOUS SYSTEMS: IAS-5, 1998, : 62 - 69
  • [42] Filtering in a unit quaternion space for model-based object tracking
    Ude, A
    ROBOTICS AND AUTONOMOUS SYSTEMS, 1999, 28 (2-3) : 163 - 172
  • [43] Filtering in a unit quaternion space for model-based object tracking
    Ude, Aleš
    Robotics and Autonomous Systems, 1999, 28 (02): : 163 - 172
  • [44] AN OBJECT TRACKING METHOD USING PARTICLE FILTER AND SCALE SPACE MODEL
    Heo, PyeongGang
    Park, Su-Jin
    Jin, Sang-Hun
    Yeou, Bo Yeoun
    Park, HyunWook
    2009 16TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-6, 2009, : 4081 - +
  • [45] State-space recursive least-squares based object tracking
    Malik, MB
    Hasan, A
    Rehman, NU
    Shahzad, M
    INMIC 2004: 8th International Multitopic Conference, Proceedings, 2004, : 180 - 183
  • [46] Visual tracking of a stochastically mobile object
    Yi, Fazhen
    Jiang, Yonglin
    Li, Jincheng
    ISSCAA 2006: 1ST INTERNATIONAL SYMPOSIUM ON SYSTEMS AND CONTROL IN AEROSPACE AND ASTRONAUTICS, VOLS 1AND 2, 2006, : 440 - +
  • [47] Graph Based Visual Object Tracking
    Zhou Guanling
    Wang Yuping
    Dong Nanping
    2009 ISECS INTERNATIONAL COLLOQUIUM ON COMPUTING, COMMUNICATION, CONTROL, AND MANAGEMENT, VOL I, 2009, : 99 - 102
  • [48] Faster MDNet for Visual Object Tracking
    Yu, Qianqian
    Fan, Keqi
    Wang, Yiyang
    Zheng, Yuhui
    APPLIED SCIENCES-BASEL, 2022, 12 (05):
  • [49] Collaborative strategy for visual object tracking
    Yang, Yongquan
    Chen, Ning
    Jiang, Shenlu
    MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (06) : 7283 - 7303
  • [50] Visual Object Tracking for Handheld Devices
    Yun, Woo-han
    Kim, Dohyung
    Lee, Jaeyeon
    Kim, Jaehong
    2013 IEEE INTERNATIONAL SYMPOSIUM ON INDUSTRIAL ELECTRONICS (ISIE), 2013,