Adaptive Two-Stage Multisensor Convolutional Autoencoder Model for Lossy Compression of Hyperspectral Data

被引:2
|
作者
Kuester, Jannick [1 ,2 ]
Gross, Wolfgang [1 ]
Schreiner, Simon [1 ]
Middelmann, Wolfgang [1 ]
Heizmann, Michael [2 ]
机构
[1] Fraunhofer Inst Optron Syst Technol & Image Explo, Dept Scene Anal, D-76275 Ettlingen, Germany
[2] Inst Ind Informat Technol IIIT, Karlsruhe Inst Technol KIT, D-76187 Karlsruhe, Germany
关键词
Autoencoder (AE); dimensionality reduction; entropy coding; feature extraction; hyperspectral imaging (HSI) compression; spectral analysis; spectral compression; PRINCIPAL COMPONENT ANALYSIS; DIMENSIONALITY REDUCTION; IMAGING SPECTROSCOPY; VECTOR QUANTIZATION; CLASSIFICATION; JPEG2000; INDEXES; IMAGES;
D O I
10.1109/TGRS.2023.3328222
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
The growing availability of hyperspectral remote sensing data, specifically from the new hyperspectral satellite missions, requires efficient data compression due to limitations in bandwidth and available storage space while simultaneously preserving the spectral characteristics. Machine learning approaches are a powerful way to address this challenge, but they are usually tailored to only work on one specific sensor. This work addresses the challenge of transferability of autoencoder (AE) models for lossy compression of spatially independent and unknown hyperspectral datasets acquired from different sensor platforms. We propose the CompNext1D, an advanced multistage adaptive network based on the architecture of the adaptive 1-D convolutional AE (A1D-CAE). The characteristic of the A1D-CAE allows pretraining on a large dataset with wide spectral variability and transferability to other sensor data, e.g., with potentially limited data availability. The compression performance of the CompNext1D is enhanced by using image statistics and shows a high degree of transferability to unknown spectral signatures. We evaluate the reconstruction accuracy with three experiments of increasing complexity. The evaluation is based on the reconstruction accuracy using the spectral angle (SA), signal-to-noise ratio (SNR), peak SNR (PSNR), and structural similarity index measure (SSIM) metrics, and the results are compared to other learning-based lossy compression techniques. We demonstrate the high transferability and generalizability of our A1D-CAE and CompNext1D for compression rates from c(g) = 4 to c(g )approximate to 100 on hyperspectral data from different sensors and carrier platforms. The CompNext1D architecture performs well in compressing hyperspectral data from multiple sensor sources with different characteristics while achieving higher reconstruction accuracy compared to state-of-the-art methods.
引用
收藏
页码:1 / 22
页数:22
相关论文
共 50 条
  • [21] SPARSE REPRESENTATION BASED LOSSY HYPERSPECTRAL DATA COMPRESSION
    Wang, Hairong
    Celik, Turgay
    2016 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2016, : 2761 - 2764
  • [22] A suitable distortion measure for the lossy compression of hyperspectral data
    Ryan, MJ
    Arnold, JF
    IGARSS '98 - 1998 INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, PROCEEDINGS VOLS 1-5: SENSING AND MANAGING THE ENVIRONMENT, 1998, : 2056 - 2058
  • [23] Assessment of effects of lossy compression of hyperspectral image data
    Su, JK
    Hsu, SM
    Orloff, S
    ALGORITHMS AND TECHNOLOGIES FOR MULTISPECTRAL, HYPERSPECTRAL, AND ULTRASPECTRAL IMAGERY X, 2004, 5425 : 402 - 413
  • [24] Multi-channel ECG data compression using two-stage adaptive vector quantization
    Miaou, SG
    Yen, HL
    Lin, CY
    PROCEEDINGS OF THE 22ND ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, VOLS 1-4, 2000, 22 : 1396 - 1399
  • [25] A Fully Embedded Two-Stage Coder for Hyperspectral Near-Lossless Compression
    Beerten, Jente
    Blanes, Ian
    Serra-Sagrista, Joan
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2015, 12 (08) : 1775 - 1779
  • [26] An Efficient Lossless Compression Scheme for Hyperspectral Images Using Two-Stage Prediction
    Lin, Cheng-Chen
    Hwang, Yin-Tsung
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2010, 7 (03) : 558 - 562
  • [27] A TWO-STAGE AUTOENCODER FOR VISUAL ANOMALY DETECTION
    Zhu, Yezhou
    Wang, Jianzhu
    Zhang, Jing
    Li, Qingyong
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 1869 - 1873
  • [28] A two-stage convolutional sparse prior model for image restoration
    Xiong, Jiaojiao
    Liu, Qiegen
    Wang, Yuhao
    Xu, Xiaoling
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2017, 48 : 268 - 280
  • [29] Analysis on Data Compression of Two-stage Sensing for Cognitive Radio
    Kobayashi, Hiroki
    Ichikawa, Haruhisa
    Kawakita, Yuusuke
    2018 IEEE 14TH INTERNATIONAL COLLOQUIUM ON SIGNAL PROCESSING & ITS APPLICATIONS (CSPA 2018), 2018, : 88 - 93
  • [30] A New Low Complexity KLT for Lossy Hyperspectral Data Compression
    Penna, Barbara
    Tillo, Tammam
    Magli, Enrico
    Olmo, Gabriella
    2006 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, VOLS 1-8, 2006, : 3525 - 3528