Seg2Sonar: A Full-Class Sample Synthesis Method Applied to Underwater Sonar Image Target Detection, Recognition, and Segmentation Tasks

被引:14
|
作者
Huang, Chao [1 ,2 ]
Zhao, Jianhu [1 ,2 ]
Zhang, Hongmei [3 ]
Yu, Yongcan [1 ,2 ]
机构
[1] Wuhan Univ, Sch Geodesy & Geomat, Wuhan 430079, Peoples R China
[2] Wuhan Univ, Inst Marine Sci & Technol, Wuhan 430079, Peoples R China
[3] Wuhan Univ, Sch Elect Engn & Automat, Dept Artificial Intelligence & Automat, Wuhan 430072, Peoples R China
关键词
Sonar; Image segmentation; Sonar detection; Shape; Target recognition; Image recognition; Feature extraction; Few samples; generating adversarial network (GAN); sample augmentation; sonar images; target detection; target segmentation; CLASSIFICATION;
D O I
10.1109/TGRS.2024.3363875
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
To overcome the challenges of limited samples, difficult acquisition, under-representation, and labeling in utilizing sonar images and deep learning (DL) for target detection, recognition, and segmentation tasks for full-class underwater targets, we propose the Seg2Sonar network based on spatially adaptive denormalization (SPADE). This network generates images through segmentation maps, thus eliminating the need for sample annotation. Additionally, we incorporate the skip-layer channel-wise excitation (SLE) module into the SPADE network to enhance feature extraction ability with minimal training samples. To improve the realism of generated images, we introduce the focal frequency loss (FFL) module, and propose the elasticity loss (EL) strategy to improve the random combination capability of the network, considering the characteristics of low resolution and severe distortion of sonar images. Furthermore, we propose a weight adjustment (WA) strategy that tackles the challenge of low and unbalanced feature representation with few samples by taking into account the unbalanced distribution of features using prior information. These four improvements enable efficient sample augmentation of sonar images with limited samples. Building upon the improved Seg2Sonar network, we propose an underwater full-class target augmentation strategy. Based on the imaging characteristics of sonar images, we classify underwater full-class targets into four categories: texture level, group level, shape level, and intensity level. We provide the corresponding augmentation strategies by leveraging similar features among sonar target images or adding external radar/optical features to supplement the diversity of features. Our experimental results demonstrate the efficacy of our proposed method in achieving sample augmentation of underwater full-class targets with minimal samples (less than ten) or even zero samples. The approach achieves about 90% accuracy in detection, recognition, and segmentation for all types of targets through DL methods. Our findings provide a promising solution for efficient sample augmentation of underwater full-class targets with limited samples.
引用
收藏
页码:1 / 19
页数:19
相关论文
共 3 条
  • [1] A Sample Augmentation Method for Side-Scan Sonar Full-Class Images That Can Be Used for Detection and Segmentation
    Yang, Zhiwei
    Zhao, Jianhu
    Yu, Yongcan
    Huang, Chao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 11
  • [2] CSLS-CycleGAN based side-scan sonar sample augmentation method for underwater target image
    Tang Y.
    Wang L.
    Yu D.
    Li H.
    Liu M.
    Zhang W.
    Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2024, 46 (05): : 1514 - 1524
  • [3] An Improved Object Detection Method for Underwater Sonar Image Based on PP-YOLOv2
    Wang, Fang
    Li, Huitao
    Wang, Kai
    Su, Lichen
    Li, Jing
    Zhang, Lili
    JOURNAL OF SENSORS, 2022, 2022