SMC-SRGAN-Lightning super-resolution algorithm based on optical micro-scanning thermal microscope image

被引:0
|
作者
Gao, Meijing [1 ,3 ]
Bai, Yang [2 ]
Xie, Yunjia [1 ]
Zhang, Bozhi [4 ]
Li, Shiyu [2 ]
Li, Zhilong [2 ]
机构
[1] Beijing Inst Technol, Coll Informat & Elect, Beijing 100081, Peoples R China
[2] Yanshan Univ, Sch Informat Sci & Engn, Key Lab Special Fiber & Fiber Sensor Hebei Prov, Qinhuangdao 066004, Peoples R China
[3] Beijing Inst Technol, Tangshan Res Inst, Beijing, Peoples R China
[4] Beijing Inst Technol, Sch Aerosp Engn, Beijing 100081, Peoples R China
来源
VISUAL COMPUTER | 2024年 / 40卷 / 12期
基金
中国国家自然科学基金;
关键词
Optical micro-scanning thermal microscope image; Super-resolution; Generative adversarial network; Deep learning; MobileNet; DEEP; NETWORK;
D O I
10.1007/s00371-023-03247-5
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Due to the low spatial resolution of the existing optical micro-scanning thermal microscope imaging system, the acquired micro-scanning infrared images have inferior image quality and low contrast. Deep learning methods, represented by SRGAN, have shown promising results in super-resolution. However, this method still has artifacts, blurriness, low spatial resolution, and slow reconstruction speed. Therefore, we propose the SMC-SRGAN-Lightning super-resolution algorithm based on optical micro-scanning thermal microscope images in this study. Firstly, we enhance the model's attention to features and improve the details and clarity of the reconstructed images. Removing the BN layer in residual blocks, replacing the ReLU with SMU, and introducing the CBAM to construct the SMC module. Secondly, we incorporate the attention mechanism SEnet into the Bottleneck structure of MobileNetV2. Reducing the channels in the first 1 x 1 convolution layer to 1/4 and creating the SE-MobileNetV2 module. It can enhance the model's focus on essential features, computational efficiency, and accuracy. Finally, to validate the effectiveness of our method, we compare it with four other super-resolution algorithms on public datasets and images obtained from the optical micro-scanning thermal microscope imaging system. Experimental results indicate that our method improves image clarity, preserving details, and textures. Comprehensively considering super-resolved image quality and time costs, our method is superior to other methods.
引用
收藏
页码:8441 / 8454
页数:14
相关论文
共 50 条
  • [1] Super-resolution imaging for infrared micro-scanning optical system
    Zhang, X. F.
    Huang, W.
    Xu, M. F.
    Jia, S. Q.
    Xu, X. R.
    Li, F. B.
    Zheng, Y. D.
    OPTICS EXPRESS, 2019, 27 (05) : 7719 - 7737
  • [2] Super-resolution reconstruction of micro-scanning images
    Zhao H.-G.
    Qu H.-S.
    Wang X.
    Shang Y.
    Liu L.-G.
    Han S.-W.
    Meng S.
    Wang P.
    Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2021, 29 (10): : 2456 - 2464
  • [3] Error correction based on micro-scanning preprocessing for an optical micro-scanning thermal microscope imaging system
    Gao, Meijing
    Xu, Jie
    Tan, Ailing
    Zu, Zhenlong
    Yang, Ming
    Wang, Jingyuan
    INFRARED PHYSICS & TECHNOLOGY, 2017, 83 : 252 - 258
  • [4] Micro-scanning error correction technique for an optical micro-scanning thermal microscope imaging system
    Gao, Mei-Jing
    Tan, Ai-Ling
    Yang, Ming
    Xu, Jie
    Zu, Zhen-Long
    Wang, Jing-Yuan
    2017 INTERNATIONAL CONFERENCE ON OPTICAL INSTRUMENTS AND TECHNOLOGY: OPTOELECTRONIC IMAGING/SPECTROSCOPY AND SIGNAL PROCESSING TECHNOLOGY, 2017, 10620
  • [5] Micro-Scanning Error Correction Technique for an Optical Micro-Scanning Thermal Microscope Imaging System
    Meijing Gao
    Ying Han
    Qiushi Geng
    Yong Zhao
    Bozhi Zhang
    Liuzhu Wang
    Journal of Beijing Institute of Technology, 2019, 28 (03) : 510 - 518
  • [6] Micro-scanning X-ray imaging system super-resolution reconstruction algorithm
    Gao, Mei-Jing
    Yang, Ming
    Zu, Zhen-Long
    Xu, Jie
    Xu, Wei
    FOURTH SEMINAR ON NOVEL OPTOELECTRONIC DETECTION TECHNOLOGY AND APPLICATION, 2018, 10697
  • [7] Design and implementation of optical micro-scanning thermal microscope imaging system with high resolution
    Gao, Meijing
    Jin, Weiqi
    Wang, Xia
    Xu, Chao
    Chen, Yinan
    Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument, 2009, 30 (05): : 1037 - 1041
  • [8] Microsphere-based super-resolution scanning optical microscope
    Huszka, Gergely
    Yang, Hui
    Gijs, Martin A. M.
    OPTICS EXPRESS, 2017, 25 (13): : 15079 - 15092
  • [9] Design and realization of high resolution optical micro-scanning thermal microscope imaging system
    Gao, MeiJing
    Tan, AiLing
    Zhang, BoZhi
    Wang, LiuZhu
    Li, ShiYu
    Chang, QiuYue
    Peng, ChunYang
    INFRARED PHYSICS & TECHNOLOGY, 2018, 95 : 46 - 52
  • [10] Research on region selection super resolution restoration algorithm based on infrared micro-scanning optical imaging model
    Chen, Jian
    Li, Yan
    Cao, LiHua
    SCIENTIFIC REPORTS, 2021, 11 (01)