Multiple-ResNet GAN: An enhanced high-resolution image generation method for translation from fundus structure image to fluorescein angiography

被引:0
|
作者
Yuan, Jiahui [1 ]
Gao, Weiwei [1 ]
Fang, Yu [1 ]
Zhang, Haifeng [1 ]
Song, Nan [2 ]
机构
[1] Shanghai Univ Engn Sci, Inst Mech & Automot Engn, Shanghai 201620, Peoples R China
[2] Fudan Univ, Dept Ophthalmol, Eye & ENT Hosp, Shanghai 200031, Peoples R China
基金
中国国家自然科学基金;
关键词
Fundus structure images; Fluorescein angiography; High-resolution; Generative adversarial network (GAN); Multiple-ResNet;
D O I
10.1007/s11517-024-03191-z
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Fluorescein angiography (FA) is a diagnostic method for observing the vascular circulation in the eye. However, it poses a risk to patients. Therefore, generative adversarial networks have been used to convert retinal fundus structure images into FA images. Existing high-resolution image generation methods employ complex deep network models that are challenging to optimize, which leads to issues such as blurred lesion boundaries and poor capture of microleakage and microvessels. In this study, we propose a multiple-ResNet generative adversarial network (GAN) to improve model training, thereby enhancing the ability to generate high-resolution FA images. First, the structure of the multiple-ResNet generator is designed to enhance detail generation in high-resolution images. Second, the Gaussian error linear unit (GELU) activation function is used to help the model converge rapidly. The effectiveness of the multiple-ResNet is verified using the publicly available Isfahan MISP dataset. Experimental results show that our method outperforms other methods, achieving better quantitative results with a mean structural similarity of 0.641, peak signal-to-noise ratio of 18.25, and learned perceptual image patch similarity of 0.272. Compared with state-of-the-art methods, the results showed that using the multiple-ResNet framework and GELU activation function can improve the generation of detailed regions in high-resolution FA images.
引用
收藏
页码:181 / 194
页数:14
相关论文
共 50 条
  • [1] Unified deep learning model for predicting fundus fluorescein angiography image from fundus structure image
    Chen, Yiwei
    He, Yi
    Ye, Hong
    Xing, Lina
    Zhang, Xin
    Shi, Guohua
    JOURNAL OF INNOVATIVE OPTICAL HEALTH SCIENCES, 2024, 17 (03)
  • [2] ISF-GAN: An Implicit Style Function for High-Resolution Image-to-Image Translation
    Liu, Yahui
    Chen, Yajing
    Bao, Linchao
    Sebe, Nicu
    Lepri, Bruno
    De Nadai, Marco
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 3343 - 3353
  • [3] Generation of Orthoimage from High-Resolution DEM and High-Resolution Image
    Saati, M.
    Amini, J.
    Sadeghian, S.
    Hosseini, S. A.
    SCIENTIA IRANICA, 2008, 15 (05) : 568 - 574
  • [4] StyleSwin: Transformer-based GAN for High-resolution Image Generation
    Zhang, Bowen
    Gu, Shuyang
    Zhang, Bo
    Bao, Jianmin
    Chen, Dong
    Wen, Fang
    Wang, Yong
    Guo, Baining
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 11294 - 11304
  • [5] High-resolution image generation from video image sequence by light field
    Kobayashi, K
    Saito, H
    VIDEOMETRICS AND OPTICAL METHODS FOR 3D SHAPE MEASUREMENT, 2001, 4309 : 318 - 327
  • [6] A HIGH-RESOLUTION IMAGE RECONSTUCTION METHOD FROM LOW-RESOLUTION IMAGE SEQUENCE
    Seong, Yeol-Min
    Park, HyunWook
    2009 16TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-6, 2009, : 1181 - 1184
  • [7] A Two-Stage GAN for High-Resolution Retinal Image Generation and Segmentation
    Andreini, Paolo
    Ciano, Giorgio
    Bonechi, Simone
    Graziani, Caterina
    Lachi, Veronica
    Mecocci, Alessandro
    Sodi, Andrea
    Scarselli, Franco
    Bianchini, Monica
    ELECTRONICS, 2022, 11 (01)
  • [8] A structure-based region detector for high-resolution retinal fundus image registration
    Ghassabi, Zeinab
    Shanbehzadeh, Jamshid
    Mohammadzadeh, Ali
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2016, 23 : 52 - 61
  • [9] Swin-UNIT: Transformer-based GAN for High-resolution Unpaired Image Translation
    Li, Yifan
    Li, Yaochen
    Tang, Wenneng
    Zhu, Zhifeng
    Yang, Jinhuo
    Liu, Yuehu
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 4657 - 4665
  • [10] High-resolution image reconstruction from multiple low-resolution images
    Wei, H
    Binnie, TD
    SEVENTH INTERNATIONAL CONFERENCE ON IMAGE PROCESSING AND ITS APPLICATIONS, 1999, (465): : 596 - 600