Fast and Lightweight Network for Single Frame Structured Illumination Microscopy Super-Resolution

被引:9
|
作者
Cheng, Xi [1 ,2 ]
Li, Jun [1 ,2 ]
Dai, Qiang [3 ]
Fu, Zhenyong [1 ,2 ]
Yang, Jian [1 ,2 ]
机构
[1] Nanjing Univ Sci & Technol, Key Lab Intelligent Percept & Syst High Dimens, Minist Educ, PCA Lab, Nanjing 210094, Peoples R China
[2] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Jiangsu Key Lab Image & Video Understanding Socia, Nanjing 210094, Peoples R China
[3] Soochow Univ, Sch Comp Sci & Technol, Suzhou 215031, Peoples R China
基金
中国博士后科学基金;
关键词
Lighting; Superresolution; Microscopy; Kernel; Convolution; Task analysis; Feature extraction; Image demoireing; structured illumination microscopy (SIM); superresolution; RESOLUTION;
D O I
10.1109/TIM.2022.3161721
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Structured illumination microscopy (SIM) is an important super-resolution-based microscopy technique that breaks the diffraction limit and enhances optical microscopy systems. With the development of biology and medical engineering, there is a high demand for real-time and robust SIM imaging under extreme low-light and short-exposure environments. Existing SIM techniques typically require multiple structured illumination frames to produce a high-resolution image. In this article, we propose a single-frame SIM (SF-SIM) based on deep learning. Our SF-SIM only needs one shot of a structured illumination frame and generates similar results compared with the traditional SIM systems that typically require 15 shots. In our SF-SIM, we propose a noise estimator that can effectively suppress the noise in the image and enable our method to work in the low-light and short-exposure environment without the need for stacking multiple frames for nonlocal denoising. We also design a bandpass attention module that makes our deep network more sensitive to the change of frequency and enhances the imaging quality. Our proposed SF-SIM is almost 14 times faster than traditional SIM methods when achieving similar results. Therefore, our method is significantly valuable for the development of microbiology and medicine.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Temporal focusing microscopy with structured illumination for super-resolution deep imaging
    Isobe, Keisuke
    Mochizuki, Kyohei
    Song, Qiyuan
    Suda, Akira
    Kannari, Fumihiko
    Kawano, Hiroyuki
    Kumagai, Akiko
    Miyawaki, Atsushi
    Midorikawa, Katsumi
    2014 CONFERENCE ON LASERS AND ELECTRO-OPTICS (CLEO), 2014,
  • [32] Speckle Flow Structured Illumination Microscopy for dynamic super-resolution imaging
    Cao, Ruiming
    Liu, Fanglin Linda
    Yeh, Li-Hao
    Meng, Guanghan
    Waller, Laura
    HIGH-SPEED BIOMEDICAL IMAGING AND SPECTROSCOPY VIII, 2023, 12390
  • [33] Structured illumination ophthalmoscope: super-resolution microscopy on the living human eye
    Schock, Florian
    Best, Gerrit
    Celik, Nil
    Heintzmann, Rainer
    Dithmar, Stefan
    Cremer, Christoph
    PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES, 2022, 380 (2220):
  • [34] Super-resolution Imaging by Two-photon Structured Illumination Microscopy
    Liu, Fan
    Jiang, Shu-rong
    Wang, Yan-hui
    Li, Qing-ru
    Zhang, Han
    2018 INTERNATIONAL CONFERENCE ON COMPUTER, COMMUNICATION AND NETWORK TECHNOLOGY (CCNT 2018), 2018, 291 : 421 - 427
  • [35] Super-resolution reconstruction of structured illumination microscopy based on pixel reassignment
    Liu, Xing
    Fang, Xiang
    Lei, Yunze
    Li, Jiaoyue
    An, Sha
    Zheng, Juanjuan
    Ma, Ying
    Ma, Haiyang
    Zalevsky, Zeev
    Gao, Peng
    APPLIED PHYSICS LETTERS, 2023, 123 (13)
  • [36] Two-photon excitation structured illumination super-resolution microscopy
    Zheng, Wei
    ADVANCED OPTICAL IMAGING TECHNOLOGIES, 2018, 10816
  • [37] Photoacoustic super-resolution microscopy using blind structured speckle illumination
    Burgholzer, P.
    Murray, T. W.
    Haltmeier, M.
    Leiss-Holzinger, E.
    Berer, T.
    PHOTONS PLUS ULTRASOUND: IMAGING AND SENSING 2017, 2017, 10064
  • [38] Digital micromirror device-based fast super-resolution lattice structured light illumination microscopy
    Yang Hao-Zhi
    Nie Meng-Jiao
    Ma Guang-Peng
    Cao Hui-Qun
    Lin Dan-Ying
    Qu Jun-Le
    Yu Bin
    ACTA PHYSICA SINICA, 2024, 73 (09)
  • [39] An efficient lightweight network for single image super-resolution*
    Tang, Yinggan
    Zhang, Xiang
    Zhang, Xuguang
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2023, 93
  • [40] Fast, Accurate, and Lightweight Super-Resolution with Cascading Residual Network
    Ahn, Namhyuk
    Kang, Byungkon
    Sohn, Kyung-Ah
    COMPUTER VISION - ECCV 2018, PT X, 2018, 11214 : 256 - 272