FourLLIE: Boosting Low-Light Image Enhancement by Fourier Frequency Information

被引:46
|
作者
Wang, Chenxi [1 ]
Wu, Hongjun [1 ]
Jin, Zhi [1 ,2 ,3 ]
机构
[1] Sun Yat Sen Univ, Guangzhou, Peoples R China
[2] Guangdong Prov Key Lab Fire Sci & Technol, Guangzhou, Peoples R China
[3] Guangdong Prov Key Lab Robot Digital Intelligent, Guangzhou, Peoples R China
来源
PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023 | 2023年
基金
中国国家自然科学基金;
关键词
Low-light image enhancement; Fourier frequency information; Amplitude transform map; Signal-to-noise-ratio map; QUALITY ASSESSMENT; RETINEX; ALGORITHM; NETWORK;
D O I
10.1145/3581783.3611909
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, Fourier frequency information has attracted much attention in Low-Light Image Enhancement (LLIE). Some researchers noticed that, in the Fourier space, the lightness degradation mainly exists in the amplitude component and the rest exists in the phase component. By incorporating both the Fourier frequency and the spatial information, these researchers proposed remarkable solutions for LLIE. In this work, we further explore the positive correlation between the magnitude of amplitude and the magnitude of lightness, which can be effectively leveraged to improve the lightness of low-light images in the Fourier space. Moreover, we find that the Fourier transform can extract the global information of the image, and does not introduce massive neural network parameters like Multi-Layer Perceptrons (MLPs) or Transformer. To this end, a two-stage Fourier-based LLIE network (FourLLIE) is proposed. In the first stage, we improve the lightness of low-light images by estimating the amplitude transform map in the Fourier space. In the second stage, we introduce the Signal-to-Noise-Ratio (SNR) map to provide the prior for integrating the global Fourier frequency and the local spatial information, which recovers image details in the spatial space. With this ingenious design, FourLLIE outperforms the existing state-of-the-art (SOTA) LLIE methods on four representative datasets while maintaining good model efficiency. Notably, compared with a recent Transformer-based SOTA method SNR-Aware, FourLLIE reaches superior performance with only 0.31% parameters. Code is available at https://github.com/wangchx67/FourLLIE.
引用
收藏
页码:7459 / 7469
页数:11
相关论文
共 50 条
  • [41] Low-light image enhancement using inverted image normalized by atmospheric light
    Jeon, Jong Ju
    Eom, I. I. Kyu
    SIGNAL PROCESSING, 2022, 196
  • [42] Frequency-guided dual-collapse Transformer for low-light image enhancement
    Lin, Jianpu
    Lai, Fangwei
    Lin, Shanling
    Lin, Zhixian
    Guo, Tailiang
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2025, 142
  • [43] SurroundNet: Towards effective low-light image enhancement
    Zhou, Fei
    Sun, Xin
    Dong, Junyu
    Zhu, Xiao Xiang
    PATTERN RECOGNITION, 2023, 141
  • [44] Invertible network for unpaired low-light image enhancement
    Jize Zhang
    Haolin Wang
    Xiaohe Wu
    Wangmeng Zuo
    The Visual Computer, 2024, 40 : 109 - 120
  • [45] Low-light image enhancement with geometrical sparse representation
    Jin Tan
    Taiping Zhang
    Linchang Zhao
    Darong Huang
    Zhenyuan Zhang
    Applied Intelligence, 2023, 53 : 11019 - 11033
  • [46] Low-light color image enhancement based on NSST
    Wu Xiaochu
    Tang Guijin
    Liu Xiaohua
    Cui Ziguan
    Luo Suhuai
    The Journal of China Universities of Posts and Telecommunications, 2019, 26 (05) : 41 - 48
  • [47] Generative adversarial network for low-light image enhancement
    Li, Fei
    Zheng, Jiangbin
    Zhang, Yuan-fang
    IET IMAGE PROCESSING, 2021, 15 (07) : 1542 - 1552
  • [48] Image Enhancement for Remote Photoplethysmography in a Low-Light Environment
    Xi, Lin
    Chen, Weihai
    Zhao, Changchen
    Wu, Xingming
    Wang, Jianhua
    2020 15TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2020), 2020, : 1 - 7
  • [49] Low-light image enhancement by diffusion pyramid with residuals
    Kim, Wonjun
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2021, 81
  • [50] Retinex-based Low-Light Image Enhancement
    Luo, Rui
    Feng, Yan
    He, Mingxin
    Zhang, Yuliang
    2023 ASIA PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE, APSIPA ASC, 2023, : 1429 - 1434