LightingFormer: Transformer-CNN hybrid network for low-light image enhancement

被引:2
|
作者
Bi, Cong [1 ]
Qian, Wenhua [1 ]
Cao, Jinde [2 ]
Wang, Xue [1 ]
机构
[1] Yunnan Univ, Sch Informat Sci & Engn, Kunming 650500, Peoples R China
[2] Southeast Univ, Sch Math, Nanjing 210096, Peoples R China
来源
COMPUTERS & GRAPHICS-UK | 2024年 / 124卷
关键词
Low-light image enhancement; Swin transformer; Attention mechanism; Deep learning;
D O I
10.1016/j.cag.2024.104089
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Recent deep-learning methods have shown promising results in low-light image enhancement. However, current methods often suffer from noise and artifacts, and most are based on convolutional neural networks, which have limitations in capturing long-range dependencies resulting in insufficient recovery of extremely dark parts in low-light images. To tackle these issues, this paper proposes a novel Transformer-based low- light image enhancement network called LightingFormer. Specifically, we propose a novel Transformer-CNN hybrid block that captures global and local information via mixed attention. It combines the advantages of the Transformer in capturing long-range dependencies and the advantages of CNNs in extracting low-level features and enhancing locality to recover extremely dark parts and enhance local details in low-light images. Moreover, we adopt the U-Net discriminator to enhance different regions in low-light images adaptively, avoiding overexposure or underexposure, and suppressing noise and artifacts. Extensive experiments show that our method outperforms the state-of-the-art methods quantitatively and qualitatively. Furthermore, the application to object detection demonstrates the potential of our method in high-level vision tasks.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] Lightening Network for Low-Light Image Enhancement
    Wang, Li-Wen
    Liu, Zhi-Song
    Siu, Wan-Chi
    Lun, Daniel P. K.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 7984 - 7996
  • [22] A Comparative Study on CNN based Low-light Image Enhancement
    Lal, Kanishk Jayant
    Rana, Deepanshu
    Parihar, Anil Singh
    2021 11TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING, DATA SCIENCE & ENGINEERING (CONFLUENCE 2021), 2021, : 459 - 464
  • [23] Inception-Based CNN for Low-Light Image Enhancement
    Panwar, Moomal
    Gaur, Sanjay B. C.
    COMPUTATIONAL VISION AND BIO-INSPIRED COMPUTING ( ICCVBIC 2021), 2022, 1420 : 533 - 545
  • [24] A novel gradient and semantic-aware transformer network for low-light image enhancement
    Zhan, Tianming
    Lu, Chenyang
    Wu, Huapeng
    Wang, Chenyun
    MULTIMEDIA SYSTEMS, 2025, 31 (02)
  • [25] Patch-Based Transformer for Low-Light Image Enhancement
    Zhang, Yu
    Jiang, Shan
    Tang, Xiangyun
    2023 IEEE INTERNATIONAL CONFERENCES ON INTERNET OF THINGS, ITHINGS IEEE GREEN COMPUTING AND COMMUNICATIONS, GREENCOM IEEE CYBER, PHYSICAL AND SOCIAL COMPUTING, CPSCOM IEEE SMART DATA, SMARTDATA AND IEEE CONGRESS ON CYBERMATICS,CYBERMATICS, 2024, : 268 - 273
  • [26] Pre-trained low-light image enhancement transformer
    Zhang, Jingyao
    Hao, Shijie
    Rao, Yuan
    IET IMAGE PROCESSING, 2024, 18 (08) : 1967 - 1984
  • [27] A transformer-CNN parallel network for image guided depth completion
    Li, Tao
    Dong, Xiucheng
    Lin, Jie
    Peng, Yonghong
    PATTERN RECOGNITION, 2024, 150
  • [28] Low-light images enhancement via a dense transformer network
    Huang, Yi
    Fu, Gui
    Ren, Wanchun
    Tu, Xiaoguang
    Feng, Ziliang
    Liu, Bokai
    Liu, Jianhua
    Zhou, Chao
    Liu, Yuang
    Zhang, Xiaoqiang
    DIGITAL SIGNAL PROCESSING, 2024, 148
  • [29] Low-Light Image Enhancement Network Based on Recursive Network
    Liu, Fangjin
    Hua, Zhen
    Li, Jinjiang
    Fan, Linwei
    FRONTIERS IN NEUROROBOTICS, 2022, 16
  • [30] Invertible network for unpaired low-light image enhancement
    Jize Zhang
    Haolin Wang
    Xiaohe Wu
    Wangmeng Zuo
    The Visual Computer, 2024, 40 : 109 - 120