Fusion Tree Network for RGBT Tracking

被引:4
|
作者
Cheng, Zhiyuan [1 ]
Lu, Andong [1 ]
Zhang, Zhang [4 ,5 ]
Li, Chenglong [2 ,3 ]
Wang, Liang [4 ,5 ]
机构
[1] Anhui Univ, Sch Comp Sci & Technol, Hefei, Peoples R China
[2] Anhui Prov Key Lab Multimodal Cognit Computat, Hefei, Peoples R China
[3] Anhui Univ, Sch Artificial Intelligence, Hefei, Peoples R China
[4] Ctr Res Intelligent Percept & Comp, NLPR, CASIA, Beijing, Peoples R China
[5] Univ Chinese Acad Sci, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1109/AVSS56176.2022.9959406
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
RGBT tracking is often affected by complex scenes ( i.e., occlusions, scale changes, noisy background, etc). Existing works usually adopt a single-strategy RGBT tracking fusion scheme to handle modalityfitsion in all scenarios. However, due to the limitation of fusion model capacity, it is difficult to fully integrate the discriminative features between different modalities. 'lb tackle this problem, we propose a Fusion Tree Network (FTNet), which provides a multistrategy fusion model with high capacity to efficiently fuse different modalities. Specifically, we combine three kinds of attention modules ( i.e., channel attention, spatial attention, and location attention) in a tree structure to achieve multi-path hybrid attention in the deeper convolutional stages of the object tracking network Extensive experiments are performed on three RGBT tracking datasets, and the results show that our method achieves superior performance among state-of-the-art RGBT tracking models.
引用
收藏
页数:8
相关论文
共 50 条
  • [31] Trans-RGBT:RGBT Object Tracking with Transformer
    Wanjun, Liu
    Linlin, Liang
    Haicheng, Qu
    Computer Engineering and Applications, 2024, 60 (11) : 84 - 94
  • [32] Dynamic Feature-Memory Transformer Network for RGBT Tracking
    Li, Muyang
    Zhang, Ping
    Yan, Miao
    Chen, Hu
    Wu, Changke
    IEEE SENSORS JOURNAL, 2023, 23 (17) : 19692 - 19703
  • [33] Enhanced RGBT Tracking Network With Semantic Generation and Historical Context
    Gao, Zhao
    Zhou, Dongming
    Cao, Jinde
    Liu, Yisong
    Shan, Qingqing
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2025, 74
  • [34] Review and Analysis of RGBT Single Object Tracking Methods: A Fusion Perspective
    Zhang, Zhihao
    Wang, Jun
    Jin, Lei
    Li, Shengjie
    Wu, Hao
    Zhao, Jian
    Bo, Zhang
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (08)
  • [35] Duality-Gated Mutual Condition Network for RGBT Tracking
    Lu, Andong
    Qian, Cun
    Li, Chenglong
    Tang, Jin
    Wang, Liang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022,
  • [36] Multiple frequency–spatial network for RGBT tracking in the presence of motion blur
    Shenghua Fan
    Xi Chen
    Chu He
    Lei Yu
    Zhongjie Mao
    Yujin Zheng
    Neural Computing and Applications, 2023, 35 : 24389 - 24406
  • [37] Siamese transformer RGBT tracking
    Wang, Futian
    Wang, Wenqi
    Liu, Lei
    Li, Chenglong
    Tang, Jing
    APPLIED INTELLIGENCE, 2023, 53 (21) : 24709 - 24723
  • [38] An RGBT progressive fusion visual tracking with time-domain updated templates
    Guo, Yong
    Shen, Haiyun
    Chen, Jianyu
    Yuan, Jiemin
    Hongwai yu Jiguang Gongcheng/Infrared and Laser Engineering, 2024, 53 (11):
  • [39] Drone Based RGBT Tracking with Dual-Feature Aggregation Network
    Gao, Zhinan
    Li, Dongdong
    Wen, Gongjian
    Kuai, Yangliu
    Chen, Rui
    DRONES, 2023, 7 (09)
  • [40] HDINet: Hierarchical Dual-Sensor Interaction Network for RGBT Tracking
    Mei, Jiatian
    Zhou, Dongming
    Cao, Jinde
    Nie, Rencan
    Guo, Yanbu
    IEEE SENSORS JOURNAL, 2021, 21 (15) : 16915 - 16926