A self-attention multi-scale convolutional neural network method for SAR image despeckling

被引:8
|
作者
Wen, Zhiqing [1 ,2 ,3 ]
He, Yi [1 ,2 ,3 ,4 ]
Yao, Sheng [1 ,2 ,3 ]
Yang, Wang [1 ,2 ,3 ]
Zhang, Lifeng [1 ,2 ,3 ]
机构
[1] Lanzhou Jiaotong Univ, Fac Geomat, Lanzhou, Peoples R China
[2] Lanzhou Jiaotong Univ, Natl Local Joint Engn Res Ctr Technol & Applicat N, Lanzhou, Peoples R China
[3] Lanzhou Jiaotong Univ, Gansu Prov Engn Lab Natl Geog State Monitoring, Lanzhou, Peoples R China
[4] Lanzhou Jiaotong Univ, Fac Geomat, Duxing Bldg, 88 Anning West Rd, Lanzhou 1513, Peoples R China
关键词
Convolutional neural network; attention mechanism; multi-scale features; SAR image despeckling; QUALITY ASSESSMENT; WAVELET ENERGY; DEEP CNN; SEGMENTATION; NOISE; MODEL;
D O I
10.1080/01431161.2023.2173029
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
The speckle noise found in synthetic aperture radar (SAR) images severely affects the efficiency of image interpretation, retrieval and other applications. Thus, effective methods for despeckling SAR image are required. The traditional methods for SAR image despeckling fail to balance in terms of the relationship between the intensity of speckle noise filtering and the retention of texture details. Deep learning based SAR image despeckling methods have been shown to have the potential to achieve this balance. Therefore, this study proposes a self-attention multi-scale convolution neural network (SAMSCNN) method for SAR image despeckling. The advantage of the SAMSCNN method is that it considers both multi-scale feature extraction and channel attention mechanisms for multi-scale fused features. In the SAMSCNN method, multi-scale features are extracted from SAR images through convolution layers with different depths. These are concatenated; then, and an attention mechanism is introduced to assign different weights to features of different scales, obtaining multi-scale fused features with weights. Finally, the despeckled SAR image is generated through global residual noise reduction and image structure fine-tuning. The despeckling experiments in this study involved a variety of scenes using simulated and real data. The performance of the proposed model was analysed using quantitative and qualitative evaluation methods and compared to probabilistic patch-based (PPB), SAR block-matching 3-D (SAR-BM3D) and SAR-CNN methods. The experimental results show that the method proposed in this paper improves the objective indexes and shows great advantages in visual effects compared to these classical methods. The method proposed in this study can provide key technical support for the practical application of SAR images.
引用
收藏
页码:902 / 923
页数:22
相关论文
共 50 条
  • [31] Chicken Image Segmentation via Multi-Scale Attention-Based Deep Convolutional Neural Network
    Li, Wei
    Xiao, Yang
    Song, Xibin
    Lv, Na
    Jiang, Xinbo
    Huang, Yan
    Peng, Jingliang
    IEEE ACCESS, 2021, 9 : 61398 - 61407
  • [32] NONLOCAL SAR IMAGE DESPECKLING BY CONVOLUTIONAL NEURAL NETWORKS
    Cozzolino, D.
    Verdoliva, L.
    Scarpa, G.
    Poggi, G.
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 5117 - 5120
  • [33] Multi-Scale Aggregation with Self-Attention Network for Modeling Electrical Motor Dynamics
    Huang, Kuan-Chih
    Yang, Hao-Hsiang
    Chen, Wei-Ting
    2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, : 7097 - 7103
  • [34] SAR IMAGE DESPECKLING THROUGH CONVOLUTIONAL NEURAL NETWORKS
    Chierchia, G.
    Cozzolino, D.
    Poggi, G.
    Verdoliva, L.
    2017 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2017, : 5438 - 5441
  • [35] Multi-scale self-attention mixup for graph classification *
    Kong, Youyong
    Li, Jiaxing
    Zhang, Ke
    Wu, Jiasong
    PATTERN RECOGNITION LETTERS, 2023, 168 : 100 - 106
  • [36] A froth image segmentation method via generative adversarial networks with multi-scale self-attention mechanism
    Yuze Zhong
    Zhaohui Tang
    Hu Zhang
    Yongfang Xie
    Xiaoliang Gao
    Multimedia Tools and Applications, 2024, 83 : 19663 - 19682
  • [37] Multi-scale dilated convolution of convolutional neural network for image denoising
    Yanjie Wang
    Guodong Wang
    Chenglizhao Chen
    Zhenkuan Pan
    Multimedia Tools and Applications, 2019, 78 : 19945 - 19960
  • [38] Multi-Scale Dilated Convolutional Neural Network for Hyperspectral Image Classification
    Shanshan Zheng
    Wen Liu
    Rui Shan
    Jingyi Zhao
    Guoqian Jiang
    Zhi Zhang
    JournalofHarbinInstituteofTechnology(NewSeries), 2021, 28 (04) : 25 - 32
  • [39] Multi-scale dilated convolution of convolutional neural network for image denoising
    Wang, Yanjie
    Wang, Guodong
    Chen, Chenglizhao
    Pan, Zhenkuan
    MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (14) : 19945 - 19960
  • [40] Multi-Scale Feature Learning Convolutional Neural Network for Image Denoising
    Zhang, Shuo
    Liu, Chunyu
    Zhang, Yuxin
    Liu, Shuai
    Wang, Xun
    SENSORS, 2023, 23 (18)