Adaptive deep learning framework for robust unsupervised underwater image enhancement

被引:0
|
作者
Saleh, Alzayat [1 ]
Sheaves, Marcus [1 ]
Jerry, Dean [1 ,2 ]
Azghadi, Mostafa Rahimi [1 ,2 ]
机构
[1] James Cook Univ, Coll Sci & Engn, 1 James Cook Dr, Townsville, Qld 4814, Australia
[2] James Cook Univ, ARC Hub Supercharging Trop Aquaculture Genet Solut, Townsville, Qld, Australia
基金
澳大利亚研究理事会;
关键词
Computer vision; Convolutional neural networks; Underwater image enhancement; Variational autoencoder; Machine learning; Deep learning;
D O I
10.1016/j.eswa.2024.126314
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
One of the main challenges in deep learning-based underwater image enhancement is the limited availability of high-quality training data. Underwater images are often difficult to capture and typically suffer from distortion, colour loss, and reduced contrast, complicating the training of supervised deep learning models on large and diverse datasets. This limitation can adversely affect the performance of the model. In this paper, we propose an alternative approach to supervised underwater image enhancement. Specifically, we introduce a novel framework called Uncertainty Distribution Network (UDnet), which adapts to uncertainty distribution during its unsupervised reference map (label) generation to produce enhanced output images. UDnet enhances underwater images by adjusting contrast, saturation, and gamma correction. It incorporates a statistically guided multicolour space stretch module (SGMCSS) to generate a reference map, which is utilized by a U-Net-like conditional variational autoencoder module (cVAE) for feature extraction. These features are then processed by a Probabilistic Adaptive Instance Normalization (PAdaIN) block that encodes the feature uncertainties for the final image enhancement. The SGMCSS module ensures visual consistency with the input image and eliminates the need for manual human annotation. Consequently, UDnet can learn effectively with limited data and achieve state-of-the-art results. We evaluated UDnet on eight publicly available datasets, and the results demonstrate that it achieves competitive performance compared to other state-of-the-art methods in both quantitative and qualitative metrics. Our code is publicly available at https://github.com/alzayats/UDnet.
引用
收藏
页数:16
相关论文
共 50 条
  • [31] A Hybrid Framework for Underwater Image Enhancement
    Li, Xinjie
    Hou, Guojia
    Tan, Lu
    Liu, Wanquan
    IEEE ACCESS, 2020, 8 (08): : 197448 - 197462
  • [32] Global structure-guided learning framework for underwater image enhancement
    Runjia Lin
    Jinyuan Liu
    Risheng Liu
    Xin Fan
    The Visual Computer, 2022, 38 : 4419 - 4434
  • [33] Learning-based Underwater Image Enhancement with Adaptive Color Mapping
    Farhadifard, Fahimeh
    Zhou, Zhiliang
    von Lukas, Uwe Freiherr
    ISPA 2015 9TH INTERNATIONAL SYMPOSIUM ON IMAGE AND SIGNAL PROCESSING AND ANALYSIS, 2015, : 48 - 53
  • [34] Unsupervised Underwater Image Enhancement Based on Feature Disentanglement
    Liu Yancheng
    Dong Zhangwei
    Zhu Pengli
    Liu Siyuan
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2022, 44 (10) : 3389 - 3398
  • [35] Lighting the darkness in the sea: A deep learning model for underwater image enhancement
    Xie, Yaofeng
    Yu, Zhibin
    Yu, Xiao
    Zheng, Bing
    FRONTIERS IN MARINE SCIENCE, 2022, 9
  • [36] Adaptive Deep Learning Network With Multi-Scale and Multi-Dimensional Features for Underwater Image Enhancement
    Qiao, Nianzu
    Dong, Lu
    Sun, Changyin
    IEEE TRANSACTIONS ON BROADCASTING, 2023, 69 (02) : 482 - 494
  • [37] Deep Learning Based Underwater Image Enhancement Using Deep Convolution Neural Network
    Ray, Sharmita
    Baghel, Amit
    Bhatia, Vimal
    2022 SECOND INTERNATIONAL CONFERENCE ON ADVANCES IN ELECTRICAL, COMPUTING, COMMUNICATION AND SUSTAINABLE TECHNOLOGIES (ICAECT), 2022,
  • [38] A Deep Learning-Based Underwater Image Enhancement Scheme for Turbid Underwater Aquaculture Environments
    Hu, Wu-Chih
    Chen, Liang-Bi
    Yu, Po-Ju
    Wu, Ming-Yuan
    Chen, Kai-Hung
    Huang, Xiang-Rui
    2024 6TH INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATION AND THE INTERNET, ICCCI 2024, 2024, : 107 - 112
  • [39] Underwater Image Enhancement With Reinforcement Learning
    Sun, Shixin
    Wang, Hao
    Zhang, Hao
    Li, Mingjie
    Xiang, Ming
    Luo, Cai
    Ren, Peng
    IEEE JOURNAL OF OCEANIC ENGINEERING, 2024, 49 (01) : 249 - 261
  • [40] CUTS: A Deep Learning and Topological Framework for Multigranular Unsupervised Medical Image Segmentation
    Liu, Chen
    Amodio, Matthew
    Shen, Liangbo L.
    Gao, Feng
    Avesta, Arman
    Aneja, Sanjay
    Wang, Jay C.
    Del Priore, Lucian V.
    Krishnaswamy, Smita
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT VIII, 2024, 15008 : 155 - 165