Super-resolution for asymmetric resolution of FIB-SEM 3D imaging using AI with deep learning

被引:62
|
作者
Hagita, Katsumi [1 ]
Higuchi, Takeshi [2 ]
Jinnai, Hiroshi [2 ]
机构
[1] Natl Def Acad, Dept Appl Phys, Yokosuka, Kanagawa 2398686, Japan
[2] Tohoku Univ, Inst Multidisciplinary Res Adv Mat, Aoba Ku, 2-1-1 Katahira, Sendai, Miyagi 9808577, Japan
来源
SCIENTIFIC REPORTS | 2018年 / 8卷
关键词
ELECTRON TOMOGRAPHY; NEURAL-NETWORKS; SYSTEMS;
D O I
10.1038/s41598-018-24330-1
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Scanning electron microscopy equipped with a focused ion beam (FIB-SEM) is a promising three-dimensional (3D) imaging technique for nano-and meso-scale morphologies. In FIB-SEM, the specimen surface is stripped by an ion beam and imaged by an SEM installed orthogonally to the FIB. The lateral resolution is governed by the SEM, while the depth resolution, i.e., the FIB milling direction, is determined by the thickness of the stripped thin layer. In most cases, the lateral resolution is superior to the depth resolution; hence, asymmetric resolution is generated in the 3D image. Here, we propose a new approach based on an image-processing or deep-learning-based method for super-resolution of 3D images with such asymmetric resolution, so as to restore the depth resolution to achieve symmetric resolution. The deep-learning-based method learns from high-resolution sub-images obtained via SEM and recovers low-resolution sub-images parallel to the FIB milling direction. The 3D morphologies of polymeric nano-composites are used as test images, which are subjected to the deep-learning-based method as well as conventional methods. We find that the former yields superior restoration, particularly as the asymmetric resolution is increased. Our super-resolution approach for images having asymmetric resolution enables observation time reduction.
引用
收藏
页数:8
相关论文
共 50 条
  • [31] 3D SAR imaging using a hybrid decomposition super-resolution technique
    Kuklinski, WS
    Kraay, AL
    ALGORITHMS FOR SYNTHETIC APERTURE RADAR IMAGERY XI, 2004, 5427 : 188 - 199
  • [32] 3D Super-resolution Label-free Imaging
    Kassamakov, Ivan
    Nolvi, Anton
    Haeggstrom, Edward
    2016 CONFERENCE ON LASERS AND ELECTRO-OPTICS (CLEO), 2016,
  • [33] Sculpted light for 3D super-resolution imaging and more
    Vaziri, Alipasha
    Tang, Jianyong
    Shank, Charles
    ABSTRACTS OF PAPERS OF THE AMERICAN CHEMICAL SOCIETY, 2009, 238
  • [34] 3D Super-Resolution Imaging with Blinking Quantum Dots
    Wang, Yong
    Fruhwirth, Gilbert
    Cai, En
    Tony Ng
    Selvin, Paul R.
    BIOPHYSICAL JOURNAL, 2014, 106 (02) : 200A - 200A
  • [35] 3D In Vitro Ultrasound Super-Resolution Imaging using a Clinical System
    Christensen-Jeffries, Kirsten
    Harput, Sevan
    Brown, Jemma
    Zhang, Ge
    Zhu, Jiaqi
    Tang, Meng-Xing
    Dunsby, Christopher
    Eckersley, Robert
    2018 IEEE INTERNATIONAL ULTRASONICS SYMPOSIUM (IUS), 2018,
  • [36] 3D Reconstruction for Super-Resolution CT Images in the Internet of Health Things Using Deep Learning
    Zhang, Jing
    Gong, Ling-Rui
    Yu, Keping
    Qi, Xin
    Wen, Zheng
    Hua, Qiaozhi
    Myint, San Hlaing
    IEEE ACCESS, 2020, 8 : 121513 - 121525
  • [37] CycleSR: Unsupervised Learning for 3D fingerprint Super-Resolution
    Yao, Yongbo
    Wang, Haixia
    Zhang, Yilong
    INTERNATIONAL CONFERENCE ON OPTICAL AND PHOTONIC ENGINEERING, ICOPEN 2023, 2024, 13069
  • [38] 3-D super-resolution localization microscopy using deep learning method
    Lu, Mengyang
    Zhou, Tianyang
    Liu, Xin
    OPTICS IN HEALTH CARE AND BIOMEDICAL OPTICS IX, 2020, 11190
  • [39] Enhanced FIB-SEM systems for large-volume 3D imaging
    Xu, C. Shan
    Hayworth, Kenneth J.
    Lu, Zhiyuan
    Grob, Patricia
    Hassan, Ahmed M.
    Garcia-Cerdan, Jose G.
    Niyogi, Krishna K.
    Nogales, Eva
    Weinberg, Richard J.
    Hess, Harald F.
    ELIFE, 2017, 6
  • [40] Multiscale brain MRI super-resolution using deep 3D convolutional networks
    Pham, Chi-Hieu
    Tor-Diez, Carlos
    Meunier, Helene
    Bednarek, Nathalie
    Fablet, Ronan
    Passat, Nicolas
    Rousseau, Francois
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2019, 77