SMC-SRGAN-Lightning super-resolution algorithm based on optical micro-scanning thermal microscope image

被引:0
|
作者
Gao, Meijing [1 ,3 ]
Bai, Yang [2 ]
Xie, Yunjia [1 ]
Zhang, Bozhi [4 ]
Li, Shiyu [2 ]
Li, Zhilong [2 ]
机构
[1] Beijing Inst Technol, Coll Informat & Elect, Beijing 100081, Peoples R China
[2] Yanshan Univ, Sch Informat Sci & Engn, Key Lab Special Fiber & Fiber Sensor Hebei Prov, Qinhuangdao 066004, Peoples R China
[3] Beijing Inst Technol, Tangshan Res Inst, Beijing, Peoples R China
[4] Beijing Inst Technol, Sch Aerosp Engn, Beijing 100081, Peoples R China
来源
VISUAL COMPUTER | 2024年 / 40卷 / 12期
基金
中国国家自然科学基金;
关键词
Optical micro-scanning thermal microscope image; Super-resolution; Generative adversarial network; Deep learning; MobileNet; DEEP; NETWORK;
D O I
10.1007/s00371-023-03247-5
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Due to the low spatial resolution of the existing optical micro-scanning thermal microscope imaging system, the acquired micro-scanning infrared images have inferior image quality and low contrast. Deep learning methods, represented by SRGAN, have shown promising results in super-resolution. However, this method still has artifacts, blurriness, low spatial resolution, and slow reconstruction speed. Therefore, we propose the SMC-SRGAN-Lightning super-resolution algorithm based on optical micro-scanning thermal microscope images in this study. Firstly, we enhance the model's attention to features and improve the details and clarity of the reconstructed images. Removing the BN layer in residual blocks, replacing the ReLU with SMU, and introducing the CBAM to construct the SMC module. Secondly, we incorporate the attention mechanism SEnet into the Bottleneck structure of MobileNetV2. Reducing the channels in the first 1 x 1 convolution layer to 1/4 and creating the SE-MobileNetV2 module. It can enhance the model's focus on essential features, computational efficiency, and accuracy. Finally, to validate the effectiveness of our method, we compare it with four other super-resolution algorithms on public datasets and images obtained from the optical micro-scanning thermal microscope imaging system. Experimental results indicate that our method improves image clarity, preserving details, and textures. Comprehensively considering super-resolved image quality and time costs, our method is superior to other methods.
引用
收藏
页码:8441 / 8454
页数:14
相关论文
共 50 条
  • [31] Image Super-resolution Reconstruction Algorithm Based on Bayesian Theory
    Zheng, Wenbo
    Deng, Fei
    Mo, Shaocong
    Jin, Xin
    Qu, Yili
    Zhou, Jiangwei
    Zou, Rui
    Shuai, Jia
    Xie, Zefeng
    Long, Sijie
    Zheng, Chengfeng
    PROCEEDINGS OF THE 2018 13TH IEEE CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA 2018), 2018, : 1934 - 1938
  • [32] Image super-resolution algorithm based on deep learning network
    Chen, Jian
    Wang, Xiang
    Li, Qinrui
    BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, 2021, 128 : 180 - 181
  • [33] Image super-resolution processing approach based on genetic algorithm
    Tao, HJ
    Jia, KM
    Tong, XJ
    Advanced Materials and Devices for Sensing and Imaging II, 2005, 5633 : 447 - 452
  • [34] A super-resolution method of retinal image based on laser scanning ophthalmoscope
    Chen, Zelin
    Wang, Xingzheng
    Deng, Yuanlong
    AI IN OPTICS AND PHOTONICS (AOPC 2019), 2019, 11342
  • [35] Optical Fiber Bundle-Based High-Speed and Precise Micro-Scanning for Image High-Resolution Reconstruction
    Jiang, Jiali
    Zhou, Xin
    Liu, Jiaying
    Pan, Likang
    Pan, Ziting
    Zou, Fan
    Li, Ziqiang
    Li, Feng
    Ma, Xiaoyu
    Geng, Chao
    Zuo, Jing
    Li, Xinyang
    SENSORS, 2022, 22 (01)
  • [36] Micro-displacement super-resolution based on video image restoration
    Han, Mei
    Wang, Minghui
    PROCEEDINGS OF THE FOURTH INTERNATIONAL CONFERENCE ON IMAGE AND GRAPHICS, 2007, : 51 - +
  • [37] Super-resolution algorithm for lensless microscope based on Z-axis correction
    Chen, Yang
    Lu, Linpeng
    Wu, Xuejuan
    Zhang, Jialin
    Zuo, Chao
    HOLOGRAPHY, DIFFRACTIVE OPTICS, AND APPLICATIONS XI, 2021, 11898
  • [38] Based on the technique of regularization MAP super-resolution image reconstruction algorithm
    Zha, Zhiyuan
    Liu, Hui
    Li, Junkui
    2014 SEVENTH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID 2014), VOL 1, 2014, : 31 - 33
  • [39] The face image super-resolution algorithm based on combined representation learning
    Chen, Yuantao
    Phonevilay, Volachith
    Tao, Jiajun
    Chen, Xi
    Xia, Runlong
    Zhang, Qian
    Yang, Kai
    Xiong, Jie
    Xie, Jingbo
    MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (20) : 30839 - 30861
  • [40] Research on Super-resolution Image Reconstruction Based on an Improved POCS Algorithm
    Xu, Haiming
    Miao, Hong
    Yang, Chong
    Xiong, Cheng
    INTERNATIONAL CONFERENCE ON OPTICAL AND PHOTONIC ENGINEERING (ICOPEN 2015), 2015, 9524