Task-Friendly Underwater Image Enhancement for Machine Vision Applications

被引:7
|
作者
Yu, Meng [1 ]
Shen, Liquan [2 ]
Wang, Zhengyong [1 ]
Hua, Xia [2 ]
机构
[1] Shanghai Univ, Sch Commun & Informat Engn, Shanghai 200444, Peoples R China
[2] Shanghai Univ, Key Lab Specialty Fiber Opt & Opt Access Networks, Joint Int Res Lab Specialty Fiber Opt & Adv Commun, Shanghai 200444, Peoples R China
基金
中国国家自然科学基金;
关键词
Contrastive learning; disentangled representation (DR); machine vision tasks; underwater image enhancement (UIE);
D O I
10.1109/TGRS.2023.3340244
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Underwater images are often affected by color cast and blurring, which degrade the performance of underwater machine vision tasks. While existing underwater image enhancement (UIE) methods have been proposed to improve image quality for human perception, their effectiveness in enhancing machine vision performance is limited. In this article, a novel unsupervised UIE framework based on disentangled representation (DR) is proposed, which is designed for machine vision tasks. Specifically, the proposed framework disentangles the underwater image into two parts in the latent space according to whether they are beneficial to machine vision tasks: the task-friendly content features and the task-unfriendly distortion features. In addition, a semantic-aware contrastive module (SACM) is employed to alleviate the impact of losing key information required for machine vision tasks using the strategy of contrastive learning. Furthermore, two branches on the features and images are incorporated into the enhancement network, which serve the purpose of delivering task-relevant information to the enhancement model and guide the network to generate task-friendly images. Evaluation of the proposed method is conducted on multiple underwater image datasets, and a comparison is made with state-of-the-art enhancement methods in terms of machine vision performance. The experimental results demonstrate that the proposed method surpasses existing approaches in improving the accuracy and robustness of machine vision tasks, including object detection, semantic segmentation, and saliency detection in underwater environments. Our code is available at https://github.com/gemyumeng/TFUIE.
引用
收藏
页码:1 / 14
页数:14
相关论文
共 50 条
  • [21] An Underwater Image Vision Enhancement Algorithm Based on Contour Bougie Morphology
    Yuan, Jieyu
    Cao, Wei
    Cai, Zhanchuan
    Su, Binghua
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (10): : 8117 - 8128
  • [22] A dam crack image enhancement algorithm based on underwater biological vision
    Fan, Xin-Nan
    Gu, Li-Ping
    Wu, Peng
    Zhang, Zhuo
    Zhang, Xue-Wu
    Shi, Peng-Fei
    Guangdianzi Jiguang/Journal of Optoelectronics Laser, 2014, 25 (02): : 372 - 377
  • [23] MTNet: A multi-task cascaded network for underwater image enhancement
    Moran, Ju
    Qing, Hu
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (06) : 17629 - 17643
  • [24] MTNet: A multi-task cascaded network for underwater image enhancement
    Ju Moran
    Hu Qing
    Multimedia Tools and Applications, 2024, 83 : 17629 - 17643
  • [25] Prior-Guided Contrastive Image Compression for Underwater Machine Vision
    Fang, Zhengkai
    Shen, Liquan
    Li, Mengyao
    Wang, Zhengyong
    Jin, Yanliang
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (06) : 2950 - 2961
  • [26] Image Processing: Machine Vision Applications VII Introduction
    Niel, Kurt S.
    Bingham, Philip R.
    IMAGE PROCESSING: MACHINE VISION APPLICATIONS VII, 2014, 9024 : IX - IX
  • [27] Slimmable Multi-Task Image Compression for Human and Machine Vision
    Cao, Jiangzhong
    Yao, Ximei
    Zhang, Huan
    Jin, Jian
    Zhang, Yun
    Ling, Bingo Wing-Kuen
    IEEE ACCESS, 2023, 11 : 29946 - 29958
  • [28] Range imaging for underwater vision enhancement
    Rish, JW
    Blume, B
    Nellums, B
    Sackos, J
    Foster, J
    Wood, JL
    INFORMATION SYSTEMS FOR NAVY DIVERS AND AUTONOMOUS UNDERWATER VEHICLES OPERATING IN VERY SHALLOW WATER AND SURF ZONE REGIONS, 1999, 3711 : 151 - 160
  • [29] A Review on Image Enhancement and Restoration Techniques for Underwater Optical Imaging Applications
    Deluxni, N.
    Sudhakaran, Pradeep
    Kitmo
    Ndiaye, Mouhamadou Falilou
    IEEE ACCESS, 2023, 11 : 111715 - 111737
  • [30] Underwater image enhancement: a comprehensive review, recent trends, challenges and applications
    Smitha Raveendran
    Mukesh D. Patil
    Gajanan K. Birajdar
    Artificial Intelligence Review, 2021, 54 : 5413 - 5467