Dual camera snapshot high-resolution-hyperspectral imaging system with parallel joint optimization via physics-informed learning

被引:9
|
作者
Xie, Hui [1 ]
Zhao, Zhuang [1 ]
Han, Jing [1 ]
Xiong, Fengchao [2 ]
Zhang, Yi [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Elect Engn & Optoelect Technol, Nanjing 210094, Peoples R China
[2] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
基金
中国国家自然科学基金;
关键词
Coded apertures - Coded masks - Dual cameras - Hardware architecture - High resolution - Hyperspectral imaging systems - Joint optimization - Physical modelling - Snapshot spectral imaging - Spectral imaging system;
D O I
10.1364/OE.487253
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
The hardware architecture of the coded aperture snapshot spectral imaging (CASSI) system is based on a coded mask design, resulting in a poor spatial resolution of the system. Therefore, we consider the use of a physical model of optical imaging and a jointly optimized math-ematical model to design a self-supervised framework to solve the high-resolution-hyperspectral imaging problem. In this paper, we design a parallel joint optimization architecture based on a two-camera system. This framework combines the physical model of optical system and a joint optimization mathematical model, which takes full advantage of the spatial detail information provided by the color camera. The system has a strong online self-learning capability for high-resolution-hyperspectral image reconstruction, and gets rid of the dependence of supervised learning neural network methods on training data sets.(c) 2023 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement
引用
收藏
页码:14617 / 14639
页数:23
相关论文
共 19 条
  • [1] Dual camera snapshot hyperspectral imaging system via physics-informed learning
    Xie, Hui
    Zhao, Zhuang
    Han, Jing
    Zhang, Yi
    Bai, Lianfa
    Lu, Jun
    OPTICS AND LASERS IN ENGINEERING, 2022, 154
  • [2] Dual camera snapshot hyperspectral imaging system via physics-informed learning
    Xie, Hui
    Zhao, Zhuang
    Han, Jing
    Zhang, Yi
    Bai, Lianfa
    Lu, Jun
    OPTICS AND LASERS IN ENGINEERING, 2022, 154
  • [3] Hyperspectral imaging through scattering media via physics-informed learning
    Li, Yitong
    Chu, Wenxue
    Liu, Yuang
    Ma, Donglin
    OPTICS AND LASER TECHNOLOGY, 2024, 170
  • [4] High-resolution single-photon imaging with physics-informed deep learning
    Liheng Bian
    Haoze Song
    Lintao Peng
    Xuyang Chang
    Xi Yang
    Roarke Horstmeyer
    Lin Ye
    Chunli Zhu
    Tong Qin
    Dezhi Zheng
    Jun Zhang
    Nature Communications, 14 (1)
  • [5] High-resolution single-photon imaging with physics-informed deep learning
    Bian, Liheng
    Song, Haoze
    Peng, Lintao
    Chang, Xuyang
    Yang, Xi
    Horstmeyer, Roarke
    Ye, Lin
    Zhu, Chunli
    Qin, Tong
    Zheng, Dezhi
    Zhang, Jun
    NATURE COMMUNICATIONS, 2023, 14 (01)
  • [6] MiPhDUO: microwave imaging via physics-informed deep unrolled optimization
    Zumbo, Sabrina
    Mandija, Stefano
    Isernia, Tommaso
    Bevacqua, Martina T.
    INVERSE PROBLEMS, 2024, 40 (04)
  • [7] Dynamic imaging through random perturbed fibers via physics-informed learning
    Guo, Enlai
    Zhou, Chenyin
    Zhu, Shuo
    Bai, Lianfa
    Han, Jing
    OPTICS AND LASER TECHNOLOGY, 2023, 158
  • [8] GEARBOX FAULT DETECTION VIA PHYSICS-INFORMED PARALLEL DEEP LEARNING MODEL ARCHITECTURE
    Zhou, Qianyu
    Tang, J.
    PROCEEDINGS OF ASME 2023 INTERNATIONAL DESIGN ENGINEERING TECHNICAL CONFERENCES AND COMPUTERS AND INFORMATION IN ENGINEERING CONFERENCE, IDETC-CIE2023, VOL 11, 2023,
  • [9] Fast Parallel Implementation of Dual-Camera Compressive Hyperspectral Imaging System
    Zhang, Shipeng
    Huang, Hua
    Fu, Ying
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (11) : 3404 - 3414
  • [10] Adjusting Soil Temperatures with a Physics-Informed Deep Learning Model for a High-Resolution Numerical Weather Prediction System
    Wang, Qiufan
    Liu, Yubao
    Shi, Yueqin
    Hua, Shaofeng
    ATMOSPHERE, 2025, 16 (02)