LightingFormer: Transformer-CNN hybrid network for low-light image enhancement

被引:2
|
作者
Bi, Cong [1 ]
Qian, Wenhua [1 ]
Cao, Jinde [2 ]
Wang, Xue [1 ]
机构
[1] Yunnan Univ, Sch Informat Sci & Engn, Kunming 650500, Peoples R China
[2] Southeast Univ, Sch Math, Nanjing 210096, Peoples R China
来源
COMPUTERS & GRAPHICS-UK | 2024年 / 124卷
关键词
Low-light image enhancement; Swin transformer; Attention mechanism; Deep learning;
D O I
10.1016/j.cag.2024.104089
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Recent deep-learning methods have shown promising results in low-light image enhancement. However, current methods often suffer from noise and artifacts, and most are based on convolutional neural networks, which have limitations in capturing long-range dependencies resulting in insufficient recovery of extremely dark parts in low-light images. To tackle these issues, this paper proposes a novel Transformer-based low- light image enhancement network called LightingFormer. Specifically, we propose a novel Transformer-CNN hybrid block that captures global and local information via mixed attention. It combines the advantages of the Transformer in capturing long-range dependencies and the advantages of CNNs in extracting low-level features and enhancing locality to recover extremely dark parts and enhance local details in low-light images. Moreover, we adopt the U-Net discriminator to enhance different regions in low-light images adaptively, avoiding overexposure or underexposure, and suppressing noise and artifacts. Extensive experiments show that our method outperforms the state-of-the-art methods quantitatively and qualitatively. Furthermore, the application to object detection demonstrates the potential of our method in high-level vision tasks.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Generative adversarial network for low-light image enhancement
    Li, Fei
    Zheng, Jiangbin
    Zhang, Yuan-fang
    IET IMAGE PROCESSING, 2021, 15 (07) : 1542 - 1552
  • [32] A Pipeline Neural Network for Low-Light Image Enhancement
    Guo, Yanhui
    Ke, Xue
    Ma, Jie
    Zhang, Jun
    IEEE ACCESS, 2019, 7 : 13737 - 13744
  • [33] Weight Uncertainty Network for Low-Light Image Enhancement
    Jin, Yutao
    Sun, Yue
    Chen, Xiaoyan
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT VIII, ICIC 2024, 2024, 14869 : 106 - 117
  • [34] Exposure difference network for low-light image enhancement
    Jiang, Shengqin
    Mei, Yongyue
    Wang, Peng
    Liu, Qingshan
    PATTERN RECOGNITION, 2024, 156
  • [35] Hierarchical guided network for low-light image enhancement
    Feng, Xiaomei
    Li, Jinjiang
    Fan, Hui
    IET IMAGE PROCESSING, 2021, 15 (13) : 3254 - 3266
  • [36] Deep Lightening Network for Low-light Image Enhancement
    Wang, Li-Wen
    Liu, Zhi-Song
    Siu, Wan-Chi
    Lun, Daniel Pak-Kong
    2020 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2020,
  • [37] Invertible network for unpaired low-light image enhancement
    Zhang, Jize
    Wang, Haolin
    Wu, Xiaohe
    Zuo, Wangmeng
    VISUAL COMPUTER, 2024, 40 (01): : 109 - 120
  • [38] LOW-LIGHT IMAGE ENHANCEMENT USING CNN AND BRIGHT CHANNEL PRIOR
    Tao, Li
    Zhu, Chuang
    Song, Jiawen
    Lu, Tao
    Jia, Huizhu
    Xie, Xiaodong
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 3215 - 3219
  • [39] Transformer-Based Multi-scale Optimization Network for Low-Light Image Enhancement
    Niu Y.
    Lin X.
    Xu H.
    Li Y.
    Chen Y.
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2023, 36 (06): : 511 - 529
  • [40] RawFormer: An Efficient Vision Transformer for Low-Light RAW Image Enhancement
    Xu, Wanyan
    Dong, Xingbo
    Ma, Lan
    Teoh, Andrew Beng Jin
    Lin, Zhixian
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 2677 - 2681