Riesz-Quincunx-UNet Variational Autoencoder for Unsupervised Satellite Image Denoising

被引:6
|
作者
Thai, Duy H. [1 ]
Fei, Xiqi [1 ]
Le, Minh Tri [1 ]
Zufle, Andreas [2 ]
Wessels, Konrad [1 ]
机构
[1] George Mason Univ, Dept Geog & Geoinformat Sci, Fairfax, VA 22030 USA
[2] Emory Univ, Dept Comp Sci, Atlanta, GA 30322 USA
关键词
Wavelet transforms; Image segmentation; Satellites; Noise reduction; Time series analysis; Smoothing methods; Noise measurement; Deep neural networks; high-order Riesz transform; image time series decomposition; quincunx wavelet; Sentinel-2; UNet; variational autoencoder (VAE); LIFTING SCHEME; TIME-SERIES; CONTOURLET TRANSFORM; ALGORITHMS; LANDSAT; REPRESENTATIONS; PERFORMANCE; FRAMEWORK; REMOVAL; DESIGN;
D O I
10.1109/TGRS.2023.3291309
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Multiresolution deep learning approaches, such as the UNet architecture, have achieved high performance in classifying and segmenting images. Most traditional convolutional neural network (CNN) architectures commonly use pooling to enlarge the receptive field, which usually results in irreversible information loss. The UNet architecture avoids this information loss by introducing skip connections that allow the reconstruction of lost information. Leveraging this property of the UNet, this study proposes to include a Riesz-Quincunx (RQ) wavelet transform, which combines: 1) higher order Riesz wavelet transform and 2) orthogonal Quincunx wavelets (commonly used to reduce blur in medical images) inside the UNet to reduce noise in satellite images and their time-series. Combining both approaches, we introduce a hybrid RQ-UNet variational autoencoder (RQUNet-VAE) scheme for image and time series decomposition used to reduce noise in satellite imagery. By including denoising capabilities directly inside the UNet architecture, we hypothesize that our RQUNet-VAE may improve downstream image processing tasks that use the traditional UNet architecture. We present qualitative and quantitative experimental results that demonstrate that our proposed RQUNet-VAE is effective at reducing noise in satellite imagery yielding results similar to other state-of-the-art noise reduction methods. We further show that our RQUNet-VAE outperforms the UNet architecture specifically in cases where images exhibit high levels of noise. We show this result in two down-stream applications for multiband satellite images, including image time-series decomposition and image segmentation.
引用
收藏
页数:19
相关论文
共 10 条
  • [1] Unsupervised Real Image Super-Resolution via Generative Variational AutoEncoder
    Liu, Zhi-Song
    Siu, Wan-Chi
    Wang, Li-Wen
    Li, Chu-Tak
    Cani, Marie-Paule
    Chan, Yui-Lam
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 1788 - 1797
  • [2] Robust unsupervised image categorization based on variational autoencoder with disentangled latent representations
    Yang, Lin
    Fan, Wentao
    Bouguila, Nizar
    KNOWLEDGE-BASED SYSTEMS, 2022, 246
  • [3] UNSUPERVISED MULTI-SPECTRAL IMAGE SUPER-RESOLUTION BASED ON CONDITIONAL VARIATIONAL AUTOENCODER
    Han, Zhexin
    Zhao, Ning
    Zhang, Haopeng
    Jiang, Zhiguo
    IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 5127 - 5130
  • [4] Unsupervised Image Categorization Based on Variational Autoencoder and Student's-T Mixture Model
    Zhang, Yu
    Fan, Wentao
    Bouguila, Nizar
    2019 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2019), 2019, : 2403 - 2409
  • [5] Photonic unsupervised learning variational autoencoder for high-throughput and low-latency image transmission
    Chen, Yitong
    Zhou, Tiankuang
    Wu, Jiamin
    Qiao, Hui
    Lin, Xing
    Fang, Lu
    Dai, Qionghai
    SCIENCE ADVANCES, 2023, 9 (07)
  • [6] Reduced-Complexity End-to-End Variational Autoencoder for on Board Satellite Image Compression
    Alves de Oliveira, Vinicius
    Chabert, Marie
    Oberlin, Thomas
    Poulliat, Charly
    Bruno, Mickael
    Latry, Christophe
    Carlavan, Mikael
    Henrot, Simon
    Falzon, Frederic
    Camarero, Roberto
    REMOTE SENSING, 2021, 13 (03) : 1 - 27
  • [7] Score Priors Guided Deep Variational Inference for Unsupervised Real-World Single Image Denoising
    Cheng, Jun
    Liu, Tao
    Tan, Shan
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 12891 - 12902
  • [8] Unsupervised Satellite Image Time Series Clustering Using Object-Based Approaches and 3D Convolutional Autoencoder
    Kalinicheva, Ekaterina
    Sublime, Jeremie
    Trocan, Maria
    REMOTE SENSING, 2020, 12 (11)
  • [9] 3D-CTM: Unsupervised Crop Type Mapping Based on 3-D Convolutional Autoencoder and Satellite Image Time Series
    Singh, Karan
    Ranjan, Rajiv
    Ghildiyal, Sushil
    Tamaskar, Shashank
    Goel, Neeraj
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21
  • [10] Self-Supervised Variational Autoencoder for Unsupervised Object Counting from Very-High-Resolution Satellite Imagery: Applications in Dwelling Extraction in FDP Settlement Areas
    Gella, Getachew Workineh
    Gangloff, Hugo
    Wendt, Lorenz
    Tiede, Dirk
    Lang, Stefan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 18