Adaptive Two-Stage Multisensor Convolutional Autoencoder Model for Lossy Compression of Hyperspectral Data

被引:2
|
作者
Kuester, Jannick [1 ,2 ]
Gross, Wolfgang [1 ]
Schreiner, Simon [1 ]
Middelmann, Wolfgang [1 ]
Heizmann, Michael [2 ]
机构
[1] Fraunhofer Inst Optron Syst Technol & Image Explo, Dept Scene Anal, D-76275 Ettlingen, Germany
[2] Inst Ind Informat Technol IIIT, Karlsruhe Inst Technol KIT, D-76187 Karlsruhe, Germany
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2023年 / 61卷
关键词
Autoencoder (AE); dimensionality reduction; entropy coding; feature extraction; hyperspectral imaging (HSI) compression; spectral analysis; spectral compression; PRINCIPAL COMPONENT ANALYSIS; DIMENSIONALITY REDUCTION; IMAGING SPECTROSCOPY; VECTOR QUANTIZATION; CLASSIFICATION; JPEG2000; INDEXES; IMAGES;
D O I
10.1109/TGRS.2023.3328222
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
The growing availability of hyperspectral remote sensing data, specifically from the new hyperspectral satellite missions, requires efficient data compression due to limitations in bandwidth and available storage space while simultaneously preserving the spectral characteristics. Machine learning approaches are a powerful way to address this challenge, but they are usually tailored to only work on one specific sensor. This work addresses the challenge of transferability of autoencoder (AE) models for lossy compression of spatially independent and unknown hyperspectral datasets acquired from different sensor platforms. We propose the CompNext1D, an advanced multistage adaptive network based on the architecture of the adaptive 1-D convolutional AE (A1D-CAE). The characteristic of the A1D-CAE allows pretraining on a large dataset with wide spectral variability and transferability to other sensor data, e.g., with potentially limited data availability. The compression performance of the CompNext1D is enhanced by using image statistics and shows a high degree of transferability to unknown spectral signatures. We evaluate the reconstruction accuracy with three experiments of increasing complexity. The evaluation is based on the reconstruction accuracy using the spectral angle (SA), signal-to-noise ratio (SNR), peak SNR (PSNR), and structural similarity index measure (SSIM) metrics, and the results are compared to other learning-based lossy compression techniques. We demonstrate the high transferability and generalizability of our A1D-CAE and CompNext1D for compression rates from c(g) = 4 to c(g )approximate to 100 on hyperspectral data from different sensors and carrier platforms. The CompNext1D architecture performs well in compressing hyperspectral data from multiple sensor sources with different characteristics while achieving higher reconstruction accuracy compared to state-of-the-art methods.
引用
收藏
页码:1 / 22
页数:22
相关论文
共 50 条
  • [31] A two-stage model for wearable device data
    Bai, Jiawei
    Sun, Yifei
    Schrack, Jennifer A.
    Crainiceanu, Ciprian M.
    Wang, Mei-Cheng
    BIOMETRICS, 2018, 74 (02) : 744 - 752
  • [32] FAPEC-based lossless and lossy hyperspectral data compression
    Portell, Jordi
    Artigues, Gabriel
    Iudica, Riccardo
    Garcia Berro, Enrique
    HIGH-PERFORMANCE COMPUTING IN REMOTE SENSING V, 2015, 9646
  • [33] An information theoretic model for adaptive lossy compression
    Zamir, R
    Rose, K
    NINETEENTH CONVENTION OF ELECTRICAL AND ELECTRONICS ENGINEERS IN ISRAEL, 1996, : 316 - 318
  • [34] Efficient Lossy Satellite Image Compression using Hybrid Autoencoder Model
    Badr, Mohamed A.
    Elrewainy, Ahmed F.
    Elshafey, Mohamed A.
    2024 14TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING, ICEENG 2024, 2024, : 78 - 83
  • [35] Two-stage adaptive design for clinical trials with survival data
    Li, G
    Shih, WCJ
    Wang, YN
    JOURNAL OF BIOPHARMACEUTICAL STATISTICS, 2005, 15 (04) : 707 - 718
  • [36] Locality-based transfer learning on compression autoencoder for efficient scientific data lossy compression
    Wang, Nan
    Liu, Tong
    Wang, Jinzhen
    Liu, Qing
    Alibhai, Shakeel
    He, Xubin
    JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2022, 205
  • [37] Single- or two-stage compression
    Jekel, Todd B.
    Reindl, Douglas T.
    ASHRAE JOURNAL, 2008, 50 (08) : 46 - +
  • [38] Investigation of two-stage compression of gas
    V. M. Shmelev
    V. M. Nikolaev
    V. S. Ilyukhin
    D. B. Volov
    High Temperature, 2008, 46 : 77 - 83
  • [39] Investigation of two-stage compression of gas
    Shmelev, V. M.
    Nikolaev, V. M.
    Ilyukhin, V. S.
    Volov, D. B.
    HIGH TEMPERATURE, 2008, 46 (01) : 77 - 83
  • [40] Effect of encoders on the performance of lossless two-stage data compression schemes
    Logeswaran, R
    Eswaran, C
    ELECTRONICS LETTERS, 1999, 35 (18) : 1515 - 1516