Fusion Tree Network for RGBT Tracking

被引:4
|
作者
Cheng, Zhiyuan [1 ]
Lu, Andong [1 ]
Zhang, Zhang [4 ,5 ]
Li, Chenglong [2 ,3 ]
Wang, Liang [4 ,5 ]
机构
[1] Anhui Univ, Sch Comp Sci & Technol, Hefei, Peoples R China
[2] Anhui Prov Key Lab Multimodal Cognit Computat, Hefei, Peoples R China
[3] Anhui Univ, Sch Artificial Intelligence, Hefei, Peoples R China
[4] Ctr Res Intelligent Percept & Comp, NLPR, CASIA, Beijing, Peoples R China
[5] Univ Chinese Acad Sci, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1109/AVSS56176.2022.9959406
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
RGBT tracking is often affected by complex scenes ( i.e., occlusions, scale changes, noisy background, etc). Existing works usually adopt a single-strategy RGBT tracking fusion scheme to handle modalityfitsion in all scenarios. However, due to the limitation of fusion model capacity, it is difficult to fully integrate the discriminative features between different modalities. 'lb tackle this problem, we propose a Fusion Tree Network (FTNet), which provides a multistrategy fusion model with high capacity to efficiently fuse different modalities. Specifically, we combine three kinds of attention modules ( i.e., channel attention, spatial attention, and location attention) in a tree structure to achieve multi-path hybrid attention in the deeper convolutional stages of the object tracking network Extensive experiments are performed on three RGBT tracking datasets, and the results show that our method achieves superior performance among state-of-the-art RGBT tracking models.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] RGBT Tracking by Trident Fusion Network
    Zhu, Yabin
    Li, Chenglong
    Tang, Jin
    Luo, Bin
    Wang, Liang
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (02) : 579 - 592
  • [2] Dynamic Fusion Network for RGBT Tracking
    Peng, Jingchao
    Zhao, Haitao
    Hu, Zhengwei
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (04) : 3822 - 3832
  • [3] Multibranch Adaptive Fusion Network for RGBT Tracking
    Li, Yadong
    Lai, Huicheng
    Wang, Liejun
    Jia, Zhenhong
    IEEE SENSORS JOURNAL, 2022, 22 (07) : 7084 - 7093
  • [4] RMFNet: Redetection Multimodal Fusion Network for RGBT Tracking
    Zhao, Yanjie
    Lai, Huicheng
    Gao, Guxue
    APPLIED SCIENCES-BASEL, 2023, 13 (09):
  • [5] Two-stage Unidirectional Fusion Network for RGBT tracking
    Liu, Yisong
    Gao, Zhao
    Cao, Yang
    Zhou, Dongming
    KNOWLEDGE-BASED SYSTEMS, 2025, 310
  • [6] Attribute-Based Progressive Fusion Network for RGBT Tracking
    Xiao, Yun
    Yang, Mengmeng
    Li, Chenglong
    Liu, Lei
    Tang, Jin
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 2831 - 2838
  • [7] HATFNet: Hierarchical adaptive trident fusion network for RGBT tracking
    Zhao, Yanjie
    Lai, Huicheng
    Gao, Guxue
    APPLIED INTELLIGENCE, 2023, 53 (20) : 24187 - 24201
  • [8] HATFNet: Hierarchical adaptive trident fusion network for RGBT tracking
    Yanjie Zhao
    Huicheng Lai
    Guxue Gao
    Applied Intelligence, 2023, 53 : 24187 - 24201
  • [9] Deep Adaptive Fusion Network for High Performance RGBT Tracking
    Gao, Yuan
    Li, Chenglong
    Zhu, Yabin
    Tang, Jin
    He, Tao
    Wang, Futian
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 91 - 99
  • [10] RGBT dual-modal Siamese tracking network with feature fusion
    Shen Y.
    Hongwai yu Jiguang Gongcheng/Infrared and Laser Engineering, 2021, 50 (03):