Self-supervised learning for single-pixel imaging via dual-domain constraints

被引:12
|
作者
Chang, Xuyang [1 ,2 ,3 ]
Wu, Ze [1 ,2 ,3 ]
LI, Daoyu [1 ,2 ,3 ]
Zhan, Xinrui [1 ,2 ,3 ]
Yan, Rong [1 ,2 ,3 ]
Bian, Liheng [1 ,2 ,3 ,4 ]
机构
[1] Beijing Inst Technol, MIIT Key Lab Complex Field Intelligent Sensing, Beijing 100081, Peoples R China
[2] Beijing Inst Technol, Sch Informat & Elect, Beijing 100081, Peoples R China
[3] Beijing Inst Technol, Adv Res Inst Multidisciplinary Sci, Beijing 100081, Peoples R China
[4] Yangtze Delta Reg Acad, Beijing Inst Technol Jiaxing, Jiaxing 314019, Peoples R China
基金
中国国家自然科学基金;
关键词
Compendex;
D O I
10.1364/OL.483886
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Deep-learning-augmented single-pixel imaging (SPI) provides an efficient solution for target compressive sensing. However, the conventional supervised strategy suffers from laborious training and poor generalization. In this Letter, we report a self-supervised learning method for SPI reconstruction. It introduces dual-domain constraints to integrate the SPI physics model into a neural network. Specifically, in addition to the traditional measurement constraint, an extra transformation constraint is employed to ensure target plane consistency. The transformation constraint uses the invariance of reversible transformation to impose an implicit prior, which avoids the non-uniqueness of measurement constraint. A series of experiments validate that the reported technique realizes self-supervised reconstruction in various complex scenes without any paired data, ground truth, or pre-trained prior. It can tackle the underdetermined degradation and noise, with similar to 3.7-dB improvement on the PSNR index compared with the existing method. (c) 2023 Optica Publishing Group
引用
收藏
页码:1566 / 1569
页数:4
相关论文
共 50 条
  • [41] PiPa: Pixel- and Patch-wise Self-supervised Learning for Domain Adaptative Semantic Segmentation
    Chen, Mu
    Zheng, Zhedong
    Yang, Yi
    Chua, Tat-Seng
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 1905 - 1914
  • [42] Quantitative imaging for optical field via a single-pixel detector
    Li, Xianye
    Sun, Yafei
    He, Yikang
    Li, Xun
    Sun, Baoqing
    SIGNAL PROCESSING, 2021, 188
  • [43] Quantitative imaging for optical field via a single-pixel detector
    Li, Xianye
    Sun, Yafei
    He, Yikang
    Li, Xun
    Sun, Baoqing
    Signal Processing, 2021, 188
  • [44] Fast Fourier single-pixel imaging via binary illumination
    Zibang Zhang
    Xueying Wang
    Guoan Zheng
    Jingang Zhong
    Scientific Reports, 7
  • [45] Advances and Challenges of Single-Pixel Imaging Based on Deep Learning
    Song, Kai
    Bian, Yaoxing
    Wang, Dong
    Li, Runrui
    Wu, Ku
    Liu, Hongrui
    Qin, Chengbing
    Hu, Jianyong
    Xiao, Liantuan
    LASER & PHOTONICS REVIEWS, 2024,
  • [46] Self-Supervised Learning for Domain Adaptation on Point Clouds
    Achituve, Idan
    Maron, Haggai
    Chechik, Gal
    2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2021), 2021, : 123 - 133
  • [47] Single-pixel imaging using physics enhanced deep learning
    Wang, Fei
    Wang, Chenglong
    Deng, Chenjin
    Han, Shensheng
    Situ, Guohai
    PHOTONICS RESEARCH, 2022, 10 (01) : 104 - 110
  • [48] Research Progress of Single-Pixel Imaging Based on Deep Learning
    Wang Qi
    Mi Jiashuai
    LASER & OPTOELECTRONICS PROGRESS, 2024, 61 (10)
  • [49] Deep-learning enables single-pixel spectral imaging
    Li, Zhangyuan
    Qu, Gang
    Suo, Jinli
    Yuan, Xin
    OPTOELECTRONIC IMAGING AND MULTIMEDIA TECHNOLOGY IX, 2022, 12317
  • [50] Equipment optimization for time-domain THz single-pixel imaging
    Stantchev, Rayko, I
    Costa, Goncalo
    Pickwell-MacPherson, Emma
    2022 47TH INTERNATIONAL CONFERENCE ON INFRARED, MILLIMETER AND TERAHERTZ WAVES (IRMMW-THZ 2022), 2022,