Adaptive deep learning framework for robust unsupervised underwater image enhancement

被引:0
|
作者
Saleh, Alzayat [1 ]
Sheaves, Marcus [1 ]
Jerry, Dean [1 ,2 ]
Azghadi, Mostafa Rahimi [1 ,2 ]
机构
[1] James Cook Univ, Coll Sci & Engn, 1 James Cook Dr, Townsville, Qld 4814, Australia
[2] James Cook Univ, ARC Hub Supercharging Trop Aquaculture Genet Solut, Townsville, Qld, Australia
基金
澳大利亚研究理事会;
关键词
Computer vision; Convolutional neural networks; Underwater image enhancement; Variational autoencoder; Machine learning; Deep learning;
D O I
10.1016/j.eswa.2024.126314
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
One of the main challenges in deep learning-based underwater image enhancement is the limited availability of high-quality training data. Underwater images are often difficult to capture and typically suffer from distortion, colour loss, and reduced contrast, complicating the training of supervised deep learning models on large and diverse datasets. This limitation can adversely affect the performance of the model. In this paper, we propose an alternative approach to supervised underwater image enhancement. Specifically, we introduce a novel framework called Uncertainty Distribution Network (UDnet), which adapts to uncertainty distribution during its unsupervised reference map (label) generation to produce enhanced output images. UDnet enhances underwater images by adjusting contrast, saturation, and gamma correction. It incorporates a statistically guided multicolour space stretch module (SGMCSS) to generate a reference map, which is utilized by a U-Net-like conditional variational autoencoder module (cVAE) for feature extraction. These features are then processed by a Probabilistic Adaptive Instance Normalization (PAdaIN) block that encodes the feature uncertainties for the final image enhancement. The SGMCSS module ensures visual consistency with the input image and eliminates the need for manual human annotation. Consequently, UDnet can learn effectively with limited data and achieve state-of-the-art results. We evaluated UDnet on eight publicly available datasets, and the results demonstrate that it achieves competitive performance compared to other state-of-the-art methods in both quantitative and qualitative metrics. Our code is publicly available at https://github.com/alzayats/UDnet.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Unsupervised Deep-Learning Approach for Underwater Image Enhancement
    Espinosa, Alejandro Rico
    McIntosh, Declan
    Albu, Alexandra Branzan
    ADVANCES IN VISUAL COMPUTING, ISVC 2023, PT II, 2023, 14362 : 233 - 244
  • [2] Learning Deep Scene Curve for Fast and Robust Underwater Image Enhancement
    Xue, Xinwei
    Ma, Tianjiao
    Han, Yidong
    Ma, Long
    Liu, Risheng
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 6 - 10
  • [3] Underwater Image Enhancement with An Adaptive Dehazing Framework
    Qing, Chunmei
    Huang, Wenyou
    Zhu, Siqi
    Xu, Xiangmin
    2015 IEEE INTERNATIONAL CONFERENCE ON DIGITAL SIGNAL PROCESSING (DSP), 2015, : 338 - 342
  • [4] Underwater Image Enhancement With a Deep Residual Framework
    Liu, Peng
    Wang, Guoyu
    Qi, Hao
    Zhang, Chufeng
    Zheng, Haiyong
    Yu, Zhibin
    IEEE ACCESS, 2019, 7 : 94614 - 94629
  • [5] NPT-UL: An Underwater Image Enhancement Framework Based on Nonphysical Transformation and Unsupervised Learning
    Liang, Dan
    Chu, Jiale
    Cui, Yuguo
    Zhai, Zhanhu
    Wang, Dingcai
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 19
  • [6] A Deep Learning Approach for Underwater Image Enhancement
    Perez, Javier
    Attanasio, Aleks C.
    Nechyporenko, Nataliya
    Sanz, Pedro J.
    BIOMEDICAL APPLICATIONS BASED ON NATURAL AND ARTIFICIAL COMPUTING, PT II, 2017, 10338 : 183 - 192
  • [7] Underwater Image Enhancement using Deep Learning
    Naresh Kumar
    Juveria Manzar
    Shubham Shivani
    Multimedia Tools and Applications, 2023, 82 : 46789 - 46809
  • [8] Underwater Image Enhancement using deep learning
    Kumar, Naresh
    Manzar, Juveria
    Shivani
    Garg, Shubham
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (30) : 46789 - 46809
  • [9] Integrating deep learning and traditional image enhancement techniques for underwater image enhancement
    Shi, Zhenghao
    Wang, Yongli
    Zhou, Zhaorun
    Ren, Wenqi
    IET IMAGE PROCESSING, 2022, 16 (13) : 3471 - 3484
  • [10] Adaptive Learning Attention Network for Underwater Image Enhancement
    Liu, Shiben
    Fan, Huijie
    Lin, Sen
    Wang, Qiang
    Ding, Naida
    Tang, Yandong
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (02): : 5326 - 5333