Side-Scan Sonar Image Generation Under Zero and Few Samples for Underwater Target Detection

被引:2
|
作者
Li, Liang [1 ,2 ,3 ]
Li, Yiping [1 ,2 ,3 ,4 ]
Wang, Hailin [1 ,2 ,3 ]
Yue, Chenghai [1 ,2 ,3 ,4 ]
Gao, Peiyan [1 ,2 ,3 ]
Wang, Yuliang [1 ,2 ,3 ]
Feng, Xisheng [1 ,2 ,3 ,4 ]
机构
[1] Chinese Acad Sci, Shenyang Inst Automat, State Key Lab Robot, Shenyang 110016, Peoples R China
[2] Chinese Acad Sci, Inst Robot & Intelligent Mfg, Shenyang 110169, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[4] Key Lab Marine Robot, Shenyang 110169, Peoples R China
基金
中国国家自然科学基金;
关键词
side-scan sonar; image processing; underwater target detection; deep learning;
D O I
10.3390/rs16224134
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
The acquisition of side-scan sonar (SSS) images is complex, expensive, and time-consuming, making it difficult and sometimes impossible to obtain rich image data. Therefore, we propose a novel image generation algorithm to solve the problem of insufficient training datasets for SSS-based target detection. For zero-sample detection, we proposed a two-step style transfer approach. The ray tracing method was first used to obtain an optically rendered image of the target. Subsequently, UA-CycleGAN, which combines U-net, soft attention, and HSV loss, was proposed for generating high-quality SSS images. A one-stage image-generation approach was proposed for few-sample detection. The proposed ADA-StyleGAN3 incorporates an adaptive discriminator augmentation strategy into StyleGAN3 to solve the overfitting problem of the generative adversarial network caused by insufficient training data. ADA-StyleGAN3 generated high-quality and diverse SSS images. In simulation experiments, the proposed image-generation algorithm was evaluated subjectively and objectively. We also compared the proposed algorithm with other classical methods to demonstrate its advantages. In addition, we applied the generated images to a downstream target detection task, and the detection results further demonstrated the effectiveness of the image generation algorithm. Finally, the generalizability of the proposed algorithm was verified using a public dataset.
引用
收藏
页数:23
相关论文
共 50 条
  • [21] Side-Scan Sonar Image Generator Based on Diffusion Models for Autonomous Underwater Vehicles
    Zhang, Feihu
    Hou, Xujia
    Wang, Zewen
    Cheng, Chensheng
    Tan, Tingfeng
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2024, 12 (08)
  • [22] Side-Scan Sonar Underwater Target Detection: Combining the Diffusion Model With an Improved YOLOv7 Model
    Wen, Xin
    Zhang, Feihu
    Cheng, Chensheng
    Hou, Xujia
    Pan, Guang
    IEEE JOURNAL OF OCEANIC ENGINEERING, 2024, 49 (03) : 976 - 991
  • [23] Enhancement Techniques for Side-Scan Sonar Image Mosaics
    Zhao, Mei
    Hu, Changqing
    INTERNATIONAL SYMPOSIUM ON SIGNAL PROCESSING BIOMEDICAL ENGINEERING, AND INFORMATICS (SPBEI 2013), 2014, : 1157 - 1163
  • [24] Geometric Correction Method of Side-scan Sonar Image
    Ye, Xiufen
    Yang, Haibo
    Jia, Yunpeng
    Liu, Jun
    OCEANS 2019 - MARSEILLE, 2019,
  • [25] Research on underwater target location based on side-scan sonar carried by unmanned surface vehicle
    Zuo Z.
    Huang H.
    Sun B.
    Wu P.
    Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument, 2023, 44 (11): : 310 - 319
  • [26] Research on Side-scan Sonar Image Target Classification Method Based on Transfer Learning
    Ye, Xiufen
    Li, Chuanlong
    Zhang, Siyuan
    Yang, Peng
    Li, Xiang
    OCEANS 2018 MTS/IEEE CHARLESTON, 2018,
  • [27] Underwater Side-Scan Sonar Target Detection: YOLOv7 Model Combined with Attention Mechanism and Scaling Factor
    Wen, Xin
    Wang, Jian
    Cheng, Chensheng
    Zhang, Feihu
    Pan, Guang
    REMOTE SENSING, 2024, 16 (13)
  • [28] Feature Extraction and Target Classification of Side-Scan Sonar Images
    Rhinelander, Jason
    PROCEEDINGS OF 2016 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (SSCI), 2016,
  • [29] MFSANet: Zero-Shot Side-Scan Sonar Image Recognition Based on Style Transfer
    Xu, Hongli
    Bai, Zhongyu
    Zhang, Xiangyue
    Ding, Qichuan
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [30] High-Resolution Underwater Mapping Using Side-Scan Sonar
    Burguera, Antoni
    Oliver, Gabriel
    PLOS ONE, 2016, 11 (01):