Investigating intrinsic degradation factors by multi-branch aggregation for real-world underwater image enhancement

被引:28
|
作者
Xue, Xinwei [1 ,3 ]
Li, Zexuan [2 ]
Ma, Long [2 ]
Jia, Qi [1 ,3 ]
Liu, Risheng [1 ,3 ]
Fan, Xin [1 ,3 ]
机构
[1] Dalian Univ Technol, RU Int Sch Informat Sci & Engn, DUT, Dalian, Liaoning, Peoples R China
[2] Dalian Univ Technol, Sch Software Technol, Dalian, Liaoning, Peoples R China
[3] Dalian Univ Technol, Engn & Key Lab Ubiquitous Network & Serv Software, Dalian, Peoples R China
基金
国家重点研发计划;
关键词
Underwater image enhancement; Multi -branch learning; Real -world underwater images; Comprehensive evaluation;
D O I
10.1016/j.patcog.2022.109041
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, improving the visual quality of underwater images has received extensive attentions in both computer vision and ocean engineering fields. However, existing works mostly focus on directly learning clear images from degraded observations but without careful investigations on the intrinsic degradation factors, thus require mass training data and lack generalization ability. In this work, we propose a new method, named Multi-Branch Aggregation Network (termed as MBANet) to partially address the above issue. Specifically, by analyzing underwater degradation factors from the perspective of both color dis-tortions and veil effects, MBANet first constructs a multi-branch multi-variable architecture to obtain one intermediate coarse result and two degraded factors. We then establish a physical model inspired process to fully utilize our estimated degraded factors and thus obtain the desired clear output images. A series of evaluations on multiple datasets show the superiority of our method against existing state-of-the-art approaches, both in execution speed and accuracy. Furthermore, we demonstrate that our MBANet can significantly improve the performance of salience object detection in the underwater environment.(c) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页数:16
相关论文
共 50 条
  • [31] Recovery for underwater image degradation with multi-stage progressive enhancement
    Liu, Junnan
    Liu, Zhilin
    Wei, Yanhui
    Ouyang, Wenjia
    OPTICS EXPRESS, 2022, 30 (07) : 11704 - 11725
  • [32] Real-World Underwater Enhancement: Challenges, Benchmarks, and Solutions Under Natural Light
    Liu, Risheng
    Fan, Xin
    Zhu, Ming
    Hou, Minjun
    Luo, Zhongxuan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (12) : 4861 - 4875
  • [33] Generalized equation for real-world image enhancement by Milano Retinex family
    Lecca, Michela
    JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2020, 37 (05) : 849 - 858
  • [34] Joint Contrast Enhancement and Exposure Fusion for Real-World Image Dehazing
    Liu, Xiaoning
    Li, Hui
    Zhu, Ce
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 3934 - 3946
  • [35] Real-world image dehazing with improved joint enhancement and exposure fusion
    Kaplan, Nur Huseyin
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2023, 90
  • [36] Real-World Scene Image Enhancement with Contrastive Domain Adaptation Learning
    Zhang, Yongheng
    Cai, Yuanqiang
    Yan, Danfeng
    Lin, Rongheng
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (12)
  • [37] Dynamic degradation learning for real-world image super-resolution
    Chunxiao Fan
    Qiong Wu
    Xiang Ye
    Signal, Image and Video Processing, 2023, 17 : 315 - 322
  • [38] Dynamic degradation learning for real-world image super-resolution
    Fan, Chunxiao
    Wu, Qiong
    Ye, Xiang
    SIGNAL IMAGE AND VIDEO PROCESSING, 2023, 17 (02) : 315 - 322
  • [39] Underwater video consistent enhancement: a real-world dataset and solution with progressive quality learning
    Yongchang Zhang
    Qi Qi
    Kunqian Li
    Dandan Liu
    Multimedia Tools and Applications, 2024, 83 : 7335 - 7361
  • [40] Underwater video consistent enhancement: a real-world dataset and solution with progressive quality learning
    Zhang, Yongchang
    Qi, Qi
    Li, Kunqian
    Liu, Dandan
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (03) : 7335 - 7361