SMC-SRGAN-Lightning super-resolution algorithm based on optical micro-scanning thermal microscope image

被引:0
|
作者
Gao, Meijing [1 ,3 ]
Bai, Yang [2 ]
Xie, Yunjia [1 ]
Zhang, Bozhi [4 ]
Li, Shiyu [2 ]
Li, Zhilong [2 ]
机构
[1] Beijing Inst Technol, Coll Informat & Elect, Beijing 100081, Peoples R China
[2] Yanshan Univ, Sch Informat Sci & Engn, Key Lab Special Fiber & Fiber Sensor Hebei Prov, Qinhuangdao 066004, Peoples R China
[3] Beijing Inst Technol, Tangshan Res Inst, Beijing, Peoples R China
[4] Beijing Inst Technol, Sch Aerosp Engn, Beijing 100081, Peoples R China
来源
VISUAL COMPUTER | 2024年 / 40卷 / 12期
基金
中国国家自然科学基金;
关键词
Optical micro-scanning thermal microscope image; Super-resolution; Generative adversarial network; Deep learning; MobileNet; DEEP; NETWORK;
D O I
10.1007/s00371-023-03247-5
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Due to the low spatial resolution of the existing optical micro-scanning thermal microscope imaging system, the acquired micro-scanning infrared images have inferior image quality and low contrast. Deep learning methods, represented by SRGAN, have shown promising results in super-resolution. However, this method still has artifacts, blurriness, low spatial resolution, and slow reconstruction speed. Therefore, we propose the SMC-SRGAN-Lightning super-resolution algorithm based on optical micro-scanning thermal microscope images in this study. Firstly, we enhance the model's attention to features and improve the details and clarity of the reconstructed images. Removing the BN layer in residual blocks, replacing the ReLU with SMU, and introducing the CBAM to construct the SMC module. Secondly, we incorporate the attention mechanism SEnet into the Bottleneck structure of MobileNetV2. Reducing the channels in the first 1 x 1 convolution layer to 1/4 and creating the SE-MobileNetV2 module. It can enhance the model's focus on essential features, computational efficiency, and accuracy. Finally, to validate the effectiveness of our method, we compare it with four other super-resolution algorithms on public datasets and images obtained from the optical micro-scanning thermal microscope imaging system. Experimental results indicate that our method improves image clarity, preserving details, and textures. Comprehensively considering super-resolved image quality and time costs, our method is superior to other methods.
引用
收藏
页码:8441 / 8454
页数:14
相关论文
共 50 条
  • [41] The face image super-resolution algorithm based on combined representation learning
    Yuantao Chen
    Volachith Phonevilay
    Jiajun Tao
    Xi Chen
    Runlong Xia
    Qian Zhang
    Kai Yang
    Jie Xiong
    Jingbo Xie
    Multimedia Tools and Applications, 2021, 80 : 30839 - 30861
  • [42] A PCA-BASED SUPER-RESOLUTION ALGORITHM FOR SHORT IMAGE SEQUENCES
    Miravet, Carlos
    Rodriguez, Francisco B.
    2010 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, 2010, : 2025 - 2028
  • [43] Image Super-resolution Reconstruction Algorithm Based on Convolutional Neural Network
    He Jingxuan
    Zhang Jian
    Zhang Yonghui
    Wang Rong
    PROCEEDINGS OF 2018 IEEE INTERNATIONAL CONFERENCE ON AUTOMATION, ELECTRONICS AND ELECTRICAL ENGINEERING (AUTEEE), 2018, : 267 - 271
  • [44] Super-resolution Reconstruction Algorithm for Depth Image Based on Fractional Calculus
    Huang, Tingsheng
    Wang, Xinjian
    Wang, Chunyang
    Liu, Xuelian
    Yu, Yanqing
    Qiu, Wenqian
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 389 - 396
  • [45] SVM-based blind super-resolution image restoration algorithm
    Qiao, Jian-Ping
    Liu, Ju
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2007, 35 (10): : 1927 - 1933
  • [46] Super-Resolution Image Reconstruction Based on an Improved Maximum a Posteriori Algorithm
    Fangbiao Li
    Xin He
    Zhonghui Wei
    Zhiya Mu
    Muyu Li
    JournalofBeijingInstituteofTechnology, 2018, 27 (02) : 237 - 240
  • [47] Single Image Super-resolution Reconstruction Algorithm Based on Eage Selection
    Zhang, Yaolan
    Liu, Yijun
    MATERIALS SCIENCE, ENERGY TECHNOLOGY, AND POWER ENGINEERING I, 2017, 1839
  • [48] Image Super-resolution Reconstruction Based on Online dictionary learning Algorithm
    Yan, Chunman
    Zhang, Yuyao
    2020 16TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND SECURITY (CIS 2020), 2020, : 324 - 327
  • [49] Color Image Super-resolution Algorithm based on SVM Classified Learning
    Li, Jianfei
    Yang, Xiaoping
    Chen, Zhihong
    Yang, Haifeng
    Liu, Jun
    AOPC 2017: OPTICAL SENSING AND IMAGING TECHNOLOGY AND APPLICATIONS, 2017, 10462
  • [50] A Lagrange Multiplier-based Regularization Algorithm for Image Super-resolution
    Li, Bai
    Miao, Lixin
    Zhang, Canrong
    Yang, Wenming
    2018 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL ENGINEERING AND ENGINEERING MANAGEMENT (IEEE IEEM), 2018, : 422 - 426