Underwater Image Enhancement Using Deep Transfer Learning Based on a Color Restoration Model

被引:19
|
作者
Zhang, Yunfeng [1 ]
Jiang, Qun [1 ]
Liu, Peide [2 ]
Gao, Shanshan [1 ]
Pan, Xiao [1 ,3 ]
Zhang, Caiming [4 ]
机构
[1] Shandong Univ Finance & Econ, Sch Comp Sci & Technol, Jinan 250014, Peoples R China
[2] Shandong Univ Finance & Econ, Inst Marine Econ & Management, Sch Management Sci & Engn, Jinan 250014, Peoples R China
[3] Shandong Univ Finance & Econ, Shandong Res Ctr, China US Digital Media Int Cooperat, Jinan 250014, Peoples R China
[4] Shandong Univ, Sch Comp Sci & Technol, Jinan 250100, Peoples R China
关键词
Image color analysis; Image restoration; Image enhancement; Degradation; Cameras; Adaptation models; Attenuation; Coarse granularity similarity; physical model; transfer learning; underwater image enhancement;
D O I
10.1109/JOE.2022.3227393
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
In ocean engineering, an underwater vehicle is widely used as an important equipment to explore the ocean. However, due to the reflection and attenuation of light when propagating in water, the images captured by the visual system of an underwater vehicle in the complex underwater environment usually suffer from low visibility, blurred details, and color distortion. To solve this problem, in this article, we present an underwater image enhancement framework based on transfer learning, which consists of a domain transformation module and an image enhancement module. The two modules, respectively, perform color correction and image enhancement, effectively transferring in-air image dehazing to underwater image enhancement. To maintain the physical properties of an underwater image, we embed the physical model into the domain transformation module which ensures that the transformed image complies with the physical model. To effectively remove the color deviation, a coarse-grained similarity calculation is added to the domain transformation module to improve the model performance. The experimental results on real-world underwater images of different scenes show that the presented method is superior to some advanced underwater image enhancement algorithms both qualitatively and quantitatively. Furthermore, we conduct ablation experiments to indicate the contribution of each component and further validate the effectiveness of the presented method through application tests.
引用
收藏
页码:489 / 514
页数:26
相关论文
共 50 条
  • [21] A Deep Learning Approach for Underwater Image Enhancement
    Perez, Javier
    Attanasio, Aleks C.
    Nechyporenko, Nataliya
    Sanz, Pedro J.
    BIOMEDICAL APPLICATIONS BASED ON NATURAL AND ARTIFICIAL COMPUTING, PT II, 2017, 10338 : 183 - 192
  • [22] Lighting the darkness in the sea: A deep learning model for underwater image enhancement
    Xie, Yaofeng
    Yu, Zhibin
    Yu, Xiao
    Zheng, Bing
    FRONTIERS IN MARINE SCIENCE, 2022, 9
  • [23] Underwater Image Fish Recognition Technology Based on Transfer Learning and Image Enhancement
    Yuan, Hongchun
    Zhang, Shuo
    Chen, Guanqi
    Yang, Yue
    JOURNAL OF COASTAL RESEARCH, 2020, : 124 - 128
  • [24] Local Color Mapping Combined with Color Transfer for Underwater Image Enhancement
    Protasiuk, Rafal
    Bibi, Adel
    Ghanem, Bernard
    2019 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2019, : 1433 - 1439
  • [25] Underwater image restoration by color compensation and color-line model
    Li, Xinbin
    Lei, Chengbo
    Yu, Haifeng
    Feng, Yankai
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2022, 101
  • [26] HA-Net: A Hybrid Algorithm Model for Underwater Image Color Restoration and Texture Enhancement
    Qian, Jin
    Li, Hui
    Zhang, Bin
    ELECTRONICS, 2024, 13 (13)
  • [27] Model-Based Underwater Image Simulation and Learning-Based Underwater Image Enhancement Method
    Liu, Yidan
    Xu, Huiping
    Zhang, Bing
    Sun, Kelin
    Yang, Jingchuan
    Li, Bo
    Li, Chen
    Quan, Xiangqian
    INFORMATION, 2022, 13 (04)
  • [28] Underwater image color restoration based on depth estimation
    Li, Yukun
    Chen, Gang
    Chen, Jifa
    PHYSICS LETTERS A, 2024, 527
  • [29] Image Enhancement of Underwater Habitat Using Color Correction Based on Histogram
    Shamsuddin, Norsila Bt
    Ahmad, Wan Fatimah Bt Wan
    Baharudin, Baharum B.
    Rajuddin, Mohd Kushairi B. Mohd
    Mohd, Farahwahida Bt
    VISUAL INFORMATICS: SUSTAINING RESEARCH AND INNOVATIONS, PT I, 2011, 7066 : 289 - +
  • [30] Underwater Image Enhancement Based on Color Correction and Detail Enhancement
    Wu, Zeju
    Ji, Yang
    Song, Lijun
    Sun, Jianyuan
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2022, 10 (10)