Deep Learning based Data Augmentation for Restoring SAR Images

被引:0
|
作者
Aghababaei, Hossein [1 ]
Ferraioli, Giampaolo [2 ]
Vitale, Sergio [2 ]
机构
[1] Univ Twente, Fac GeoInformat Sci & Earth Observat ITC, Enschede, Netherlands
[2] Univ Napoli Parthenope, Naples, Italy
关键词
Polarimetric SAR Image; Data Augmentation; Reconstruction; Deep convolutional neural network; cost functions; Image Restoration;
D O I
10.1109/IGARSS52108.2023.10282265
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
In the context of Synthetic Aperture Radar (SAR) data, polarization is an important source of information for Earth's surface monitoring. SAR Systems are often considered to transmit only one polarization. This constraint leads to either single or dual polarimetric SAR imaging modalities. Single polarimetric systems operate with a fixed single polarization of both transmitted and received electromagnetic (EM) waves, resulting in a single acquisition channel. Dual polarimetric systems, on the other hand, transmit in one fixed polarization and receive in two orthogonal polarizations, resulting in two acquisition channels. Dual polarimetric systems are obviously more informative than single polarimetric systems and are increasingly being used for a variety of remote sensing applications. In dual polarimetric systems, the choice of polarizations for the transmitter and the receiver is open. The choice of circular transmit polarization and coherent dual linear receive polarizations forms a special dual polarimetric system called hybrid polarimetry, which brings the properties of rotational invariance to geometrical orientations of features in the scene and optimizes the design of the radar in terms of reliability, mass, and power constraints. The complete characterization of target scattering, however, requires fully polarimetric data, which can be acquired with systems that transmit two orthogonal polarizations. This adds further complexity to data acquisition and shortens the coverage area or swath of fully polarimetric images, compared to the swath of dual or hybrid polarimetric images. The search for solutions to augment dual polarimetric data to full polarimetric data will therefore take advantage of full characterization and exploitation of the backscattered field over a wider coverage with less system complexity. Several methods for reconstructing fully polarimetric images using hybrid polarimetric data can be found in the literature. Although the improvements achieved by the newly investigated and experimented reconstruction techniques are undeniable, the existing methods are, however, mostly based upon model assumptions (especially the assumption of reflectance symmetry), which may limit their reliability and applicability to vegetation and forest scenarios. To overcome the problems of these techniques, this paper proposes a new framework for reconstructing fully polarimetric information from hybrid polarimetric data. The framework uses Deep Learning solutions to augment hybrid polarimetric data without relying on model assumptions. A convolutional neural network (CNN) with a specific architecture and loss function is defined for this augmentation problem by focusing on different scattering properties of the polarimetric data. In particular, the method controls the CNN training process with respect to several characteristic features of polarimetric images defined by the combination of different terms in the cost or loss function. The proposed method is experimentally validated with real data sets and compared with a well-known and standard approach from the literature. From the experiments, the reconstruction performance of the proposed framework is superior to conventional reconstruction methods. The pseudo fully polarimetric data reconstructed by the proposed method also agree well with the actual fully polarimetric images acquired by radar systems, confirming the reliability and efficiency of the proposed method.
引用
收藏
页码:822 / 824
页数:3
相关论文
共 50 条
  • [1] Target Recognition in SAR Images by Deep Learning with Training Data Augmentation
    Geng, Zhe
    Xu, Ying
    Wang, Bei-Ning
    Yu, Xiang
    Zhu, Dai-Yin
    Zhang, Gong
    SENSORS, 2023, 23 (02)
  • [2] SAR Specific Noise Based Data Augmentation for Deep Learning
    Belloni, Carole
    Aouf, Nabil
    Le Caillec, Jean-Marc
    Merlet, Thomas
    2019 INTERNATIONAL RADAR CONFERENCE (RADAR2019), 2019, : 17 - 21
  • [3] Geostatistical Simulation of Medical Images for Data Augmentation in Deep Learning
    Tuan D Pham
    IEEE ACCESS, 2019, 7 : 68752 - 68763
  • [4] Data Augmentation-based Novel Deep Learning Method for Deepfaked Images Detection
    Iqbal, Farkhund
    Abbasi, Ahmed
    Javed, Abdul rehman
    Almadhor, Ahmad
    Jalil, Zunera
    Anwar, Sajid
    Rida, Imad
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (11)
  • [5] Change Detection in SAR Images Based on Deep Learning
    Hatem Magdy Keshk
    Xu-Cheng Yin
    International Journal of Aeronautical and Space Sciences, 2020, 21 : 549 - 559
  • [6] Change Detection in SAR Images Based on Deep Learning
    Keshk, Hatem Magdy
    Yin, Xu-Cheng
    INTERNATIONAL JOURNAL OF AERONAUTICAL AND SPACE SCIENCES, 2020, 21 (02) : 549 - 559
  • [7] Data augmentation and transfer learning to classify malware images in a deep learning context
    Niccolò Marastoni
    Roberto Giacobazzi
    Mila Dalla Preda
    Journal of Computer Virology and Hacking Techniques, 2021, 17 : 279 - 297
  • [8] Data augmentation and transfer learning to classify malware images in a deep learning context
    Marastoni, Niccolo
    Giacobazzi, Roberto
    Dalla Preda, Mila
    JOURNAL OF COMPUTER VIROLOGY AND HACKING TECHNIQUES, 2021, 17 (04) : 279 - 297
  • [9] Data Augmentation for Morphological Analysis of Histopathological Images Using Deep Learning
    Tabakov, Martin
    Karanowski, Konrad
    Chlopowiec, Adam R.
    Chlopowiec, Adrian B.
    Kasperek, Mikolaj
    COMPUTATIONAL COLLECTIVE INTELLIGENCE, ICCCI 2022, 2022, 13501 : 95 - 105
  • [10] Data Augmentation on Synthetic Images for Transfer Learning using Deep CNNs
    Talukdar, Jonti
    Biswas, Ayon
    Gupta, Sanchit
    2018 5TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND INTEGRATED NETWORKS (SPIN), 2018, : 215 - 219