Multiple-ResNet GAN: An enhanced high-resolution image generation method for translation from fundus structure image to fluorescein angiography

被引:0
|
作者
Yuan, Jiahui [1 ]
Gao, Weiwei [1 ]
Fang, Yu [1 ]
Zhang, Haifeng [1 ]
Song, Nan [2 ]
机构
[1] Shanghai Univ Engn Sci, Inst Mech & Automot Engn, Shanghai 201620, Peoples R China
[2] Fudan Univ, Dept Ophthalmol, Eye & ENT Hosp, Shanghai 200031, Peoples R China
基金
中国国家自然科学基金;
关键词
Fundus structure images; Fluorescein angiography; High-resolution; Generative adversarial network (GAN); Multiple-ResNet;
D O I
10.1007/s11517-024-03191-z
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Fluorescein angiography (FA) is a diagnostic method for observing the vascular circulation in the eye. However, it poses a risk to patients. Therefore, generative adversarial networks have been used to convert retinal fundus structure images into FA images. Existing high-resolution image generation methods employ complex deep network models that are challenging to optimize, which leads to issues such as blurred lesion boundaries and poor capture of microleakage and microvessels. In this study, we propose a multiple-ResNet generative adversarial network (GAN) to improve model training, thereby enhancing the ability to generate high-resolution FA images. First, the structure of the multiple-ResNet generator is designed to enhance detail generation in high-resolution images. Second, the Gaussian error linear unit (GELU) activation function is used to help the model converge rapidly. The effectiveness of the multiple-ResNet is verified using the publicly available Isfahan MISP dataset. Experimental results show that our method outperforms other methods, achieving better quantitative results with a mean structural similarity of 0.641, peak signal-to-noise ratio of 18.25, and learned perceptual image patch similarity of 0.272. Compared with state-of-the-art methods, the results showed that using the multiple-ResNet framework and GELU activation function can improve the generation of detailed regions in high-resolution FA images.
引用
收藏
页码:181 / 194
页数:14
相关论文
共 50 条
  • [21] Rapid image product generation from high-resolution satellite imagery for disaster management
    Trisirisatayawong, I
    Jongrujinan, T
    Fraser, C
    IGARSS 2005: IEEE International Geoscience and Remote Sensing Symposium, Vols 1-8, Proceedings, 2005, : 4168 - 4171
  • [22] Automatic cloud-free image generation from high-resolution multitemporal imagery
    Han, Youkyung
    Bovolo, Francesca
    Lee, Won Hee
    JOURNAL OF APPLIED REMOTE SENSING, 2017, 11
  • [23] Image registration with fringe projection techniques: a simple approach to form a high-resolution image from multiple low-resolution images
    Su, Wei-Hung
    Lee, Chao-Kuei
    Zeng, Jhao-yu
    Yao, Yu-Ting
    PHOTONIC FIBER AND CRYSTAL DEVICES: ADVANCES IN MATERIALS AND INNOVATIONS IN DEVICE APPLICATIONS VI, 2012, 8497
  • [24] Information extraction from high-resolution SAR image with object-oriented method
    Zhu, Junjie
    Fan, Xiangtao
    Guo, Huadong
    Wang, Changlin
    Tan, Jian
    Du, Xiaoping
    SIXTH INTERNATIONAL SYMPOSIUM ON DIGITAL EARTH: DATA PROCESSING AND APPLICATIONS, 2010, 7841
  • [25] A hybrid image segmentation method for building extraction from high-resolution RGB images
    Hossain, Mohammad D.
    Chen, Dongmei
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2022, 192 : 299 - 314
  • [26] Translation of Color Fundus Photography into High -resolution Indocyanine Green Angiography Image using Generative Adversarial Networks for Age -Related Macular Degeneration Screening
    Chen, Ruoyu
    Zhang, Weiyi
    Song, Fan
    Zheng, Yingfeng
    Yu, Honghua
    Cao, Dan
    Shi, Danli
    He, Mingguang
    INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2024, 65 (07)
  • [27] A super-resolution method-based pipeline for fundus fluorescein angiography imaging 08 Information and Computing Sciences 0801 Artificial Intelligence and Image Processing Robert Koprowski
    Jiang Z.
    Yu Z.
    Feng S.
    Huang Z.
    Peng Y.
    Guo J.
    Ren Q.
    Lu Y.
    Guo, Jianxin (guojianxin_724@126.com), 2018, BioMed Central Ltd, United Kingdom (17)
  • [28] Defect inspection using a high-resolution pattern image obtained from multiple low-resolution images of the same pattern on an observed noisy SEM image
    Takashima, Masahiko
    Midoh, Yoshihiro
    Nakamae, Koji
    METROLOGY, INSPECTION, AND PROCESS CONTROL FOR MICROLITHOGRAPHY XXII, PTS 1 AND 2, 2008, 6922 (1-2):
  • [29] Technologies leading to the next-generation digital cameras and movies (3); super-resolution: high-resolution image reconstruction from multiple low-resolution images
    Tokyo Institute of Technology, Tokyo, Japan
    Kyokai Joho Imeji Zasshi, 2008, 3 (337-342):
  • [30] Image-based assessment of spinal trabecular bone structure from high-resolution CT images
    Gordon, CL
    Lang, TF
    Augat, P
    Genant, HK
    OSTEOPOROSIS INTERNATIONAL, 1998, 8 (04) : 317 - 325