JLEDNet: a nighttime UAV tracking method through joint low-light image enhancement using hybrid attention transformer and denoising

被引:0
|
作者
Li, Yanmei [1 ]
Yu, Tao [1 ]
Luo, Jian [2 ]
Li, Xiaoshuang [1 ]
Deng, Jingshi [1 ]
Yang, Qibin [1 ]
机构
[1] Chongqing Univ Technol, Coll Artif Intelligence, Chongqing 400054, Peoples R China
[2] China West Normal Univ, Comp Sch, Nanchong 637009, Peoples R China
来源
关键词
UAV; Object tracking; Transformer; Low-light image enhancement;
D O I
10.1007/s00371-024-03784-7
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
With the rapid advancements in unmanned aerial vehicle (UAV) technologies, UAV-based visual object tracking has increasingly garnered attention. However, nighttime tracking remains challenging due to poor lighting conditions, which often impede the effectiveness of UAV trackers. To address this challenge, we introduce a novel nighttime UAV tracking method through joint low-light image enhancement using a hybrid attention transformer and denoising (named JLEDNet). In the first stage of JLEDNet (JLEDNet-stageI), we employ a U-shaped architecture for low-light image enhancement, proposing the spatial-channel hybrid attention transformer-based block (SCHATB) to enhance the network's modeling capability, and introducing the spatial-frequency convolutional block (SFCB) to improve global feature learning. In JLEDNet-stageII, we introduce the corresponding denoising scheme to remove the latent noise in the darkness amplified after the first stage. Extensive evaluation on multiple nighttime public UAV benchmarks, including UAVDark135, DarkTrack2021, UAVDark70, and NAT2021-L, demonstrate that JLEDNet significantly enhances nighttime tracking performance.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] LDNet: low-light image enhancement with joint lighting and denoising
    Li, Yuhang
    Liu, Tianyanshi
    Fan, Jiaxin
    Ding, Youdong
    MACHINE VISION AND APPLICATIONS, 2023, 34 (01)
  • [2] LDNet: low-light image enhancement with joint lighting and denoising
    Yuhang Li
    Tianyanshi Liu
    Jiaxin Fan
    Youdong Ding
    Machine Vision and Applications, 2023, 34
  • [3] Low-light image enhancement using transformer with color fusion and channel attention
    Sun, Yinbang
    Sun, Jing
    Sun, Fuming
    Wang, Fasheng
    Li, Haojie
    JOURNAL OF SUPERCOMPUTING, 2024, 80 (13): : 18365 - 18391
  • [4] A LOW-LIGHT IMAGE ENHANCEMENT METHOD FOR BOTH DENOISING AND CONTRAST ENLARGING
    Li, Lin
    Wang, Ronggang
    Wang, Wenmin
    Gao, Wen
    2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, : 3730 - 3734
  • [5] LEFuse: Joint low-light enhancement and image fusion for nighttime infrared and visible images
    Cheng, Muhang
    Huang, Haiyan
    Liu, Xiangyu
    Mo, Hongwei
    Zhao, Xiongbo
    Wu, Songling
    NEUROCOMPUTING, 2025, 626
  • [6] LEFuse: Joint low-light enhancement and image fusion for nighttime infrared and visible images
    Acar, Berat Cinar
    Yuksekdag, Zehranur
    Yilmaz, Ebru Sebnem
    INTERNATIONAL DAIRY JOURNAL, 2025, 164
  • [7] Low-light Image Enhancement with Deep Blind Denoising
    Guo, Yu
    Lu, Yuxu
    Yang, Meifang
    Liu, Ryan Wen
    ICMLC 2020: 2020 12TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND COMPUTING, 2018, : 406 - 411
  • [8] Adaptive Low-Light Image Enhancement with Decomposition Denoising
    Gao, Yin
    Yan, Chao
    Zeng, Huixiong
    Li, Qiming
    Li, Jun
    2022 7TH INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION ENGINEERING, ICRAE, 2022, : 332 - 336
  • [9] LET: a local enhancement transformer for low-light image enhancement
    Pan, Lei
    Tian, Jun
    Zheng, Yuan
    Fu, Qiang
    Zhao, Zhiqing
    JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (02)
  • [10] LightingFormer: Transformer-CNN hybrid network for low-light image enhancement
    Bi, Cong
    Qian, Wenhua
    Cao, Jinde
    Wang, Xue
    COMPUTERS & GRAPHICS-UK, 2024, 124