Adaptive Two-Stage Multisensor Convolutional Autoencoder Model for Lossy Compression of Hyperspectral Data

被引:2
|
作者
Kuester, Jannick [1 ,2 ]
Gross, Wolfgang [1 ]
Schreiner, Simon [1 ]
Middelmann, Wolfgang [1 ]
Heizmann, Michael [2 ]
机构
[1] Fraunhofer Inst Optron Syst Technol & Image Explo, Dept Scene Anal, D-76275 Ettlingen, Germany
[2] Inst Ind Informat Technol IIIT, Karlsruhe Inst Technol KIT, D-76187 Karlsruhe, Germany
关键词
Autoencoder (AE); dimensionality reduction; entropy coding; feature extraction; hyperspectral imaging (HSI) compression; spectral analysis; spectral compression; PRINCIPAL COMPONENT ANALYSIS; DIMENSIONALITY REDUCTION; IMAGING SPECTROSCOPY; VECTOR QUANTIZATION; CLASSIFICATION; JPEG2000; INDEXES; IMAGES;
D O I
10.1109/TGRS.2023.3328222
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
The growing availability of hyperspectral remote sensing data, specifically from the new hyperspectral satellite missions, requires efficient data compression due to limitations in bandwidth and available storage space while simultaneously preserving the spectral characteristics. Machine learning approaches are a powerful way to address this challenge, but they are usually tailored to only work on one specific sensor. This work addresses the challenge of transferability of autoencoder (AE) models for lossy compression of spatially independent and unknown hyperspectral datasets acquired from different sensor platforms. We propose the CompNext1D, an advanced multistage adaptive network based on the architecture of the adaptive 1-D convolutional AE (A1D-CAE). The characteristic of the A1D-CAE allows pretraining on a large dataset with wide spectral variability and transferability to other sensor data, e.g., with potentially limited data availability. The compression performance of the CompNext1D is enhanced by using image statistics and shows a high degree of transferability to unknown spectral signatures. We evaluate the reconstruction accuracy with three experiments of increasing complexity. The evaluation is based on the reconstruction accuracy using the spectral angle (SA), signal-to-noise ratio (SNR), peak SNR (PSNR), and structural similarity index measure (SSIM) metrics, and the results are compared to other learning-based lossy compression techniques. We demonstrate the high transferability and generalizability of our A1D-CAE and CompNext1D for compression rates from c(g) = 4 to c(g )approximate to 100 on hyperspectral data from different sensors and carrier platforms. The CompNext1D architecture performs well in compressing hyperspectral data from multiple sensor sources with different characteristics while achieving higher reconstruction accuracy compared to state-of-the-art methods.
引用
收藏
页码:1 / 22
页数:22
相关论文
共 50 条
  • [41] Robust Adaptive Pulse Compression Method Based on Two-Stage Phase Compensation
    Pei, Jiazheng
    Huang, Yong
    Guan, Jian
    Cai, Mi
    Chen, Baoxin
    Chen, Xiaolong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [42] High-Ratio Lossy Compression: Exploring the Autoencoder to Compress Scientific Data
    Liu, Tong
    Wang, Jinzhen
    Liu, Qing
    Alibhai, Shakeel
    Lu, Tao
    He, Xubin
    IEEE TRANSACTIONS ON BIG DATA, 2023, 9 (01) : 22 - 36
  • [43] A New Architecture of a Two-Stage Lossless Data Compression and Decompression Algorithm
    Lin, Ming-Bo
    Chang, Yung-Yi
    IEEE TRANSACTIONS ON VERY LARGE SCALE INTEGRATION (VLSI) SYSTEMS, 2009, 17 (09) : 1297 - 1303
  • [44] Sparse Representation-Based Hyperspectral Data Processing: Lossy Compression
    Wang, Hairong
    Celik, Turgay
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2017, 10 (05) : 2036 - 2045
  • [45] Unsupervised classification-based hyperspectral data processing: lossy compression
    Xiao-Yu Cheng
    Yue-Ming Wang
    Ran Guo
    Jun-Ze Huang
    Optical and Quantum Electronics, 2018, 50
  • [46] Unsupervised classification-based hyperspectral data processing: lossy compression
    Cheng, Xiao-Yu
    Wang, Yue-Ming
    Guo, Ran
    Huang, Jun-Ze
    OPTICAL AND QUANTUM ELECTRONICS, 2018, 50 (12)
  • [47] Spectrally and spatially adaptive hyperspectral data compression
    Brower, BV
    Hadcock, DH
    Reitz, JP
    Schott, J
    HYPERSPECTRAL REMOTE SENSING AND APPLICATIONS, 1996, 2821 : 55 - 63
  • [48] A DEA Model For Two-Stage Systems With Fuzzy Data
    Lozano, Sebastin
    Moreno, Placido
    2013 IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS (FUZZ - IEEE 2013), 2013,
  • [49] Deep Model Compression via Two-Stage Deep Reinforcement Learning
    Zhan, Huixin
    Lin, Wei-Ming
    Cao, Yongcan
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, 2021, 12975 : 238 - 254
  • [50] Classification of Atypical White Blood Cells in Acute Myeloid Leukemia Using a Two-Stage Hybrid Model Based on Deep Convolutional Autoencoder and Deep Convolutional Neural Network
    Elhassan, Tusneem A.
    Rahim, Mohd Shafry Mohd
    Zaiton, Mohd Hashim Siti
    Swee, Tan Tian
    Alhaj, Taqwa Ahmed
    Ali, Abdulalem
    Aljurf, Mahmoud
    DIAGNOSTICS, 2023, 13 (02)