Unsupervised Underwater Image Enhancement Combining Imaging Restoration and Prompt Learning

被引:0
|
作者
Song, Wei [1 ]
Liu, Chengbing [1 ]
Di Mauro, Mario [2 ]
Liotta, Antonio [3 ]
机构
[1] Shanghai Ocean Univ, Shanghai, Peoples R China
[2] Univ Salerno, Salerno, Italy
[3] Free Univ Bozen Bolzano, Bolzano, Italy
基金
中国国家自然科学基金;
关键词
Prompt learning; Unsupervised underwater image enhancement; FLIP perceptual loss; Underwater dark channel prior;
D O I
10.1007/978-981-97-8490-5_30
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Underwater image enhancement (UIE) based on deep learning often requires a large amount of labeled data. This study proposes a simple but effective unsupervised UIE method from the perspectives of content and style improvement by incorporating the traditional imaging restoration model and prompt learning techniques. We initially train the fast language-image pre-training (FLIP) model using unpaired underwater images to learn image-perceptive prompts for distinguishing between high and low image qualities. Meanwhile, we perform underwater image restoration via the underwater dark channel prior's method to obtain pre-restored images. Next, a simple U-net network is employed to further enhance the pre-restored image, while utilizing the FLIP prompts as the loss to guide style and content and using a consistency loss to maintain texture structure. The experiment compared the proposed UIE method with nine other methods on three datasets, and evaluated them with the metrics of UCIQE, UIQM, and NUIQ. Experimental results show that the method performs better than traditional and SOTA unsupervised methods, improving image quality and robustness, and helping to solve the problem of scarce underwater data.
引用
收藏
页码:421 / 434
页数:14
相关论文
共 50 条
  • [21] An Underwater Image Restoration Deep Learning Network Combining Attention Mechanism and Brightness Adjustment
    Zheng, Jianhua
    Zhao, Ruolin
    Yang, Gaolin
    Liu, Shuangyin
    Zhang, Zihao
    Fu, Yusha
    Lu, Junde
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2024, 12 (01)
  • [22] Unsupervised underwater image restoration via Koschmieder model disentanglement
    Zhang, Song
    An, Dong
    Li, Daoliang
    Zhao, Ran
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 266
  • [23] Adaptive regularization in image restoration by unsupervised learning
    University of Sydney, Department of Electrical Engineering, Sydney, NSW 2006, Australia
    J Electron Imaging, 1 (211-221):
  • [24] UNSUPERVISED AND UNTRAINED UNDERWATER IMAGE RESTORATION BASED ON PHYSICAL IMAGE FORMATION MODEL
    Chai, Shu
    Fu, Zhenqi
    Huang, Yue
    Tu, Xiaotong
    Ding, Xinghao
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2774 - 2778
  • [25] Adaptive regularization in image restoration by unsupervised learning
    Wong, HS
    Guan, L
    JOURNAL OF ELECTRONIC IMAGING, 1998, 7 (01) : 211 - 221
  • [26] Underwater Image Visibility Restoration Based on Underwater Imaging Model
    Yang Aiping
    Qu Chang
    Wang Jian
    Zhang Liyun
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2018, 40 (02) : 298 - 305
  • [27] Underwater Image Enhancement Using Deep Transfer Learning Based on a Color Restoration Model
    Zhang, Yunfeng
    Jiang, Qun
    Liu, Peide
    Gao, Shanshan
    Pan, Xiao
    Zhang, Caiming
    IEEE JOURNAL OF OCEANIC ENGINEERING, 2023, 48 (02) : 489 - 514
  • [28] An In-Depth Survey of Underwater Image Enhancement and Restoration
    Yang, Miao
    Hu, Jintong
    Li, Chongyi
    Rohde, Gustavo
    Du, Yixiang
    Hu, Ke
    IEEE ACCESS, 2019, 7 : 123638 - 123657
  • [29] Underwater image enhancement and restoration based on local fusion
    Gao, Yakun
    Wang, Jing
    Li, Haibin
    Feng, Lei
    JOURNAL OF ELECTRONIC IMAGING, 2019, 28 (04)
  • [30] Towards domain adaptation underwater image enhancement and restoration
    Yang, Chao
    Jiang, Longyu
    Li, Zhicheng
    Huang, Jianxing
    MULTIMEDIA SYSTEMS, 2024, 30 (02)