CLE Diffusion: Controllable Light Enhancement Diffusion Model

被引:16
|
作者
Yin, Yuyang [1 ]
Xu, Dejia [2 ]
Tan, Chuangchuang [1 ]
Liu, Ping [3 ]
Zhao, Yao [1 ]
Wei, Yunchao [1 ]
机构
[1] Beijing Jiaotong Univ, Inst Informat Sci, Beijing Key Lab Adv Informat Sci & Network, Beijing, Peoples R China
[2] Univ Texas Austin, VITA Grp, Austin, TX USA
[3] ASTAR, IHPC, Ctr Frontier AI Res, Singapore, Singapore
关键词
image processing; low light image enhancement; diffusion model; ILLUMINATION; RETINEX;
D O I
10.1145/3581783.3612145
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Low light enhancement has gained increasing importance with the rapid development of visual creation and editing. However, most existing enhancement algorithms are designed to homogeneously increase the brightness of images to a pre-defined extent, limiting the user experience. To address this issue, we propose Controllable Light Enhancement Diffusion Model, dubbed CLE Diffusion, a novel diffusion framework to provide users with rich controllability. Built with a conditional diffusion model, we introduce an illumination embedding to let users control their desired brightness level. Additionally, we incorporate the Segment-Anything Model (SAM) to enable user-friendly region controllability, where users can click on objects to specify the regions they wish to enhance. Extensive experiments demonstrate that CLE Diffusion achieves competitive performance regarding quantitative metrics, qualitative results, and versatile controllability. Project page: https://yuyangyin.github.io/CLEDiffusion/
引用
收藏
页码:8145 / 8156
页数:12
相关论文
共 50 条
  • [41] Crease enhancement diffusion
    Solé, AF
    López, A
    Sapiro, G
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2001, 84 (02) : 241 - 248
  • [42] Vesselness enhancement diffusion
    Cañero, C
    Radeva, P
    PATTERN RECOGNITION LETTERS, 2003, 24 (16) : 3141 - 3151
  • [43] INTERSTITIALCY ENHANCEMENT OF DIFFUSION
    SCHULE, W
    PHYSICS LETTERS, 1965, 14 (02): : 81 - &
  • [45] A Survey of Multimodal Controllable Diffusion Models
    Jiang, Rui
    Zheng, Guang-Cong
    Li, Teng
    Yang, Tian-Rui
    Wang, Jing-Dong
    Li, Xi
    JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2024, 39 (03) : 509 - 541
  • [46] DLDiff: Image Detail-Guided Latent Diffusion Model for Low-Light Image Enhancement
    Xue, Minglong
    He, Yanyi
    He, Jinhong
    Zhong, Senming
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 2255 - 2259
  • [47] EWRD: Entropy-Weighted Low-Light Image Enhancement via Reverse Diffusion Model
    Wu, Yuheng
    Wu, Guangyuan
    Liao, Ronghao
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2024, 2024
  • [48] Multi-Domain Multi-Scale Diffusion Model for Low-Light Image Enhancement
    Shang, Kai
    Shao, Mingwen
    Wang, Chao
    Cheng, Yuanshuo
    Wang, Shuigen
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 5, 2024, : 4722 - 4730
  • [49] Patch-Wise-Based Diffusion Model with Uncertainty Guidance for Low-Light Image Enhancement
    Li, Li
    Peng, Jishen
    Wan, Yingcai
    APPLIED SCIENCES-BASEL, 2025, 15 (03):
  • [50] Low-Light Image Enhancement Based on Maximal Diffusion Values
    Kim, Wonjun
    Lee, Ryong
    Park, Minwoo
    Lee, Sang-Hwan
    IEEE ACCESS, 2019, 7 : 129150 - 129163