Hyperspectral image dynamic range reconstruction using deep neural network-based denoising methods

被引:0
|
作者
Cheplanov, Loran [1 ,2 ]
Avidan, Shai [1 ]
Bonfil, David J. [3 ]
Klapp, Iftach [2 ]
机构
[1] Tel Aviv Univ, Sch Elect Engn, IL-69978 Tel Aviv, Israel
[2] Agr Res Org, Volcani Inst, Dept Sensing Informat & Mechanizat Engn, IL-7505101 Rishon Leziyyon, Israel
[3] Agr Res Org, Dept Vegetables & Field Crops, Gilat Res Ctr, IL-8531100 Negev, Israel
关键词
Deep neural network; Dynamic-range reconstruction; Shortening shooting time; Hyperspectral; Image denoising; Kullback-Leibler divergence loss;
D O I
10.1007/s00138-024-01523-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Hyperspectral (HS) measurement is among the most useful tools in agriculture for early disease detection. However, the cost of HS cameras that can perform the desired detection tasks is prohibitive-typically fifty thousand to hundreds of thousands of dollars. In a previous study at the Agricultural Research Organization's Volcani Institute (Israel), a low-cost, high-performing HS system was developed which included a point spectrometer and optical components. Its main disadvantage was long shooting time for each image. Shooting time strongly depends on the predetermined integration time of the point spectrometer. While essential for performing monitoring tasks in a reasonable time, shortening integration time from a typical value in the range of 200 ms to the 10 ms range results in deterioration of the dynamic range of the captured scene. In this work, we suggest correcting this by learning the transformation from data measured with short integration time to that measured with long integration time. Reduction of the dynamic range and consequent low SNR were successfully overcome using three developed deep neural networks models based on a denoising auto-encoder, DnCNN and LambdaNetworks architectures as a backbone. The best model was based on DnCNN using a combined loss function of l2\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\ell _{2}$$\end{document} and Kullback-Leibler divergence on images with 20 consecutive channels. The full spectrum of the model achieved a mean PSNR of 30.61 and mean SSIM of 0.9, showing total improvement relatively to the 10 ms measurements' mean PSNR and mean SSIM values by 60.43% and 94.51%, respectively.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Hyperspectral image dynamic range reconstruction using deep neural network-based denoising methods
    Loran Cheplanov
    Shai Avidan
    David J. Bonfil
    Iftach Klapp
    Machine Vision and Applications, 2024, 35
  • [2] Denoising in the Dark: Privacy-Preserving Deep Neural Network-Based Image Denoising
    Zheng, Yifeng
    Duan, Huayi
    Tang, Xiaoting
    Wang, Cong
    Zhou, Jiantao
    IEEE TRANSACTIONS ON DEPENDABLE AND SECURE COMPUTING, 2021, 18 (03) : 1261 - 1275
  • [3] Task-based Performance Evaluation of Deep Neural Network-based Image Denoising
    Li, Kaiyan
    Zhou, Weimin
    Li, Hua
    Anastasio, Mark A.
    MEDICAL IMAGING 2021: IMAGE PERCEPTION, OBSERVER PERFORMANCE, AND TECHNOLOGY ASSESSMENT, 2021, 11599
  • [4] Compressive hyperspectral image reconstruction with deep neural network
    Heiser, Yaron
    Oiknine, Yaniv
    Stern, Adrian
    BIG DATA: LEARNING, ANALYTICS, AND APPLICATIONS, 2019, 10989
  • [5] Wavelet enabled convolutional autoencoder based deep neural network for hyperspectral image denoising
    Arati Paul
    Ahana Kundu
    Nabendu Chaki
    Dibyendu Dutta
    C. S. Jha
    Multimedia Tools and Applications, 2022, 81 : 2529 - 2555
  • [6] Wavelet enabled convolutional autoencoder based deep neural network for hyperspectral image denoising
    Paul, Arati
    Kundu, Ahana
    Chaki, Nabendu
    Dutta, Dibyendu
    Jha, C. S.
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (02) : 2529 - 2555
  • [7] Neural network-based PET image reconstruction
    Kosugi, Y
    Sase, M
    Suganami, Y
    Uemoto, N
    Momose, T
    Nishikawa, J
    METHODS OF INFORMATION IN MEDICINE, 1997, 36 (4-5) : 329 - 331
  • [8] Hyperspectral image reconstruction by deep convolutional neural network for classification
    Li, Yunsong
    Xie, Weiying
    Li, Huaqing
    PATTERN RECOGNITION, 2017, 63 : 371 - 383
  • [9] Deep Manifold Reconstruction Neural Network for Hyperspectral Image Classification
    Li, Zhengying
    Huang, Hong
    Zhang, Zhen
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [10] Deep Manifold Reconstruction Neural Network for Hyperspectral Image Classification
    Li, Zhengying
    Huang, Hong
    Zhang, Zhen
    IEEE Geoscience and Remote Sensing Letters, 2022, 19