JLEDNet: a nighttime UAV tracking method through joint low-light image enhancement using hybrid attention transformer and denoising

被引:0
|
作者
Li, Yanmei [1 ]
Yu, Tao [1 ]
Luo, Jian [2 ]
Li, Xiaoshuang [1 ]
Deng, Jingshi [1 ]
Yang, Qibin [1 ]
机构
[1] Chongqing Univ Technol, Coll Artif Intelligence, Chongqing 400054, Peoples R China
[2] China West Normal Univ, Comp Sch, Nanchong 637009, Peoples R China
来源
关键词
UAV; Object tracking; Transformer; Low-light image enhancement;
D O I
10.1007/s00371-024-03784-7
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
With the rapid advancements in unmanned aerial vehicle (UAV) technologies, UAV-based visual object tracking has increasingly garnered attention. However, nighttime tracking remains challenging due to poor lighting conditions, which often impede the effectiveness of UAV trackers. To address this challenge, we introduce a novel nighttime UAV tracking method through joint low-light image enhancement using a hybrid attention transformer and denoising (named JLEDNet). In the first stage of JLEDNet (JLEDNet-stageI), we employ a U-shaped architecture for low-light image enhancement, proposing the spatial-channel hybrid attention transformer-based block (SCHATB) to enhance the network's modeling capability, and introducing the spatial-frequency convolutional block (SFCB) to improve global feature learning. In JLEDNet-stageII, we introduce the corresponding denoising scheme to remove the latent noise in the darkness amplified after the first stage. Extensive evaluation on multiple nighttime public UAV benchmarks, including UAVDark135, DarkTrack2021, UAVDark70, and NAT2021-L, demonstrate that JLEDNet significantly enhances nighttime tracking performance.
引用
收藏
页数:13
相关论文
共 50 条
  • [41] Low-Light Image Enhancement by Combining Transformer and Convolutional Neural Network
    Yuan, Nianzeng
    Zhao, Xingyun
    Sun, Bangyong
    Han, Wenjia
    Tan, Jiahai
    Duan, Tao
    Gao, Xiaomei
    MATHEMATICS, 2023, 11 (07)
  • [42] Low-Light Image Enhancement using Retinex-based Network with Attention Mechanism
    Ma S.
    Pan W.
    Li N.
    Du S.
    Liu H.
    Xu B.
    Xu C.
    Li X.
    International Journal of Advanced Computer Science and Applications, 2024, 15 (01) : 489 - 497
  • [43] Low-light Image Enhancement Using Attention Mechanisms on Edge-Connect Architecture
    Dudak, Muhammet Nuri
    Soylemez, Busra
    Ciftci, Serdar
    32ND IEEE SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE, SIU 2024, 2024,
  • [44] Low-Light Image Enhancement via a Deep Hybrid Network
    Ren, Wenqi
    Liu, Sifei
    Ma, Lin
    Xu, Qianqian
    Xu, Xiangyu
    Cao, Xiaochun
    Du, Junping
    Yang, Ming-Hsuan
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (09) : 4364 - 4375
  • [45] A hybrid zero-reference and dehazing network for joint low-light underground image enhancement
    Qing Du
    Shihao Zhang
    Zhipeng Wang
    Jincheng Liang
    Shijiao Yang
    Scientific Reports, 15 (1)
  • [46] Unsupervised Low-Light Image Enhancement Based on Explicit Denoising and Knowledge Distillation
    Zhang, Wenkai
    Zhang, Hao
    Liu, Xianming
    Guo, Xiaoyu
    Wang, Xinzhe
    Li, Shuiwang
    CMC-COMPUTERS MATERIALS & CONTINUA, 2025, 82 (02): : 2537 - 2554
  • [47] Retinex-Based Variational Framework for Low-Light Image Enhancement and Denoising
    Ma, Qianting
    Wang, Yang
    Zeng, Tieyong
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 5580 - 5588
  • [48] A Fusion-based Enhancement Method for Low-light UAV Images
    Liu, Haolin
    Li, Yongfu
    Zhu, Hao
    2022 34TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2022, : 5036 - 5041
  • [49] A Low-Light Image Enhancement Algorithm Using the Hybrid Strategy of Deep Learning and Image Fusion
    Xu S.-P.
    Lin Z.-Y.
    Zhang G.-Z.
    Chen X.-G.
    Li F.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2021, 49 (01): : 72 - 76
  • [50] Retinex low-light image enhancement network based on attention mechanism
    Chen, Xinyu
    Li, Jinjiang
    Hua, Zhen
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (03) : 4235 - 4255