SMC-SRGAN-Lightning super-resolution algorithm based on optical micro-scanning thermal microscope image

被引:0
|
作者
Gao, Meijing [1 ,3 ]
Bai, Yang [2 ]
Xie, Yunjia [1 ]
Zhang, Bozhi [4 ]
Li, Shiyu [2 ]
Li, Zhilong [2 ]
机构
[1] Beijing Inst Technol, Coll Informat & Elect, Beijing 100081, Peoples R China
[2] Yanshan Univ, Sch Informat Sci & Engn, Key Lab Special Fiber & Fiber Sensor Hebei Prov, Qinhuangdao 066004, Peoples R China
[3] Beijing Inst Technol, Tangshan Res Inst, Beijing, Peoples R China
[4] Beijing Inst Technol, Sch Aerosp Engn, Beijing 100081, Peoples R China
来源
VISUAL COMPUTER | 2024年 / 40卷 / 12期
基金
中国国家自然科学基金;
关键词
Optical micro-scanning thermal microscope image; Super-resolution; Generative adversarial network; Deep learning; MobileNet; DEEP; NETWORK;
D O I
10.1007/s00371-023-03247-5
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Due to the low spatial resolution of the existing optical micro-scanning thermal microscope imaging system, the acquired micro-scanning infrared images have inferior image quality and low contrast. Deep learning methods, represented by SRGAN, have shown promising results in super-resolution. However, this method still has artifacts, blurriness, low spatial resolution, and slow reconstruction speed. Therefore, we propose the SMC-SRGAN-Lightning super-resolution algorithm based on optical micro-scanning thermal microscope images in this study. Firstly, we enhance the model's attention to features and improve the details and clarity of the reconstructed images. Removing the BN layer in residual blocks, replacing the ReLU with SMU, and introducing the CBAM to construct the SMC module. Secondly, we incorporate the attention mechanism SEnet into the Bottleneck structure of MobileNetV2. Reducing the channels in the first 1 x 1 convolution layer to 1/4 and creating the SE-MobileNetV2 module. It can enhance the model's focus on essential features, computational efficiency, and accuracy. Finally, to validate the effectiveness of our method, we compare it with four other super-resolution algorithms on public datasets and images obtained from the optical micro-scanning thermal microscope imaging system. Experimental results indicate that our method improves image clarity, preserving details, and textures. Comprehensively considering super-resolved image quality and time costs, our method is superior to other methods.
引用
收藏
页码:8441 / 8454
页数:14
相关论文
共 50 条
  • [21] Image Super-resolution Reconstruction Algorithm Based on Clustering
    Zhao Xiaoqiang
    Jia Yunxia
    2015 27TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2015, : 6144 - 6148
  • [22] Image Super-Resolution Algorithm Based on RRDB Model
    Li, Huan
    IEEE ACCESS, 2021, 9 : 156260 - 156273
  • [23] Scanning microsphere array optical microscope for efficient and large area super-resolution imaging
    Zhou, Ji
    Lian, Zhaoxin
    Zhou, Chengjia
    Bi, Shusheng
    Wang, Yuliang
    JOURNAL OF OPTICS, 2020, 22 (10)
  • [24] Super-resolution optical microscope based on a water-immersion metalens
    Wen, Zhongquan
    Zhou, Yi
    Wu, Shikai
    Li, Zhen
    Liu, Kaiyuan
    Li, Yurong
    Zhang, Jinsheng
    Zhang, Zhihai
    Xiang, Jin
    Shang, Zhengguo
    Liang, Gaofeng
    She, Yin
    Chen, Gang
    OPTICS AND LASERS IN ENGINEERING, 2025, 190
  • [25] A multi-image super-resolution algorithm applied to thermal imagery
    Mandanici, Emanuele
    Tavasci, Luca
    Corsini, Francesco
    Gandolfi, Stefano
    APPLIED GEOMATICS, 2019, 11 (03) : 215 - 228
  • [26] A multi-image super-resolution algorithm applied to thermal imagery
    Emanuele Mandanici
    Luca Tavasci
    Francesco Corsini
    Stefano Gandolfi
    Applied Geomatics, 2019, 11 : 215 - 228
  • [27] Super-resolution in scanning fluorescence microscopy by means of image processing in the optical domain
    Brand, U
    Grochmalicki, J
    Hester, G
    Akduman, I
    Pike, ER
    OPTICAL BIOPSIES AND MICROSCOPIC TECHNIQUES, PROCEEDINGS OF, 1996, 2926 : 216 - 227
  • [28] Image super-resolution reconstruction algorithm based on fractional calculus
    Lei J.
    Wang H.
    Zhu L.
    Xiao J.
    Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2017, 39 (12): : 2849 - 2856
  • [29] Image super-resolution reconstruction algorithm based on channel shuffle
    Wang, Li
    He, Dongzhi
    2021 ASIA-PACIFIC CONFERENCE ON COMMUNICATIONS TECHNOLOGY AND COMPUTER SCIENCE (ACCTCS 2021), 2021, : 225 - 229
  • [30] Image Super-Resolution Algorithm Based on an Improved Sparse Autoencoder
    Huang, Detian
    Huang, Weiqin
    Yuan, Zhenguo
    Lin, Yanming
    Zhang, Jian
    Zheng, Lixin
    INFORMATION, 2018, 9 (01):