ODFormer: Semantic fundus image segmentation using Transformer for optic nerve head detection

被引:0
|
作者
Wang, Jiayi [1 ,2 ,3 ,4 ]
Mao, Yi-An [5 ]
Ma, Xiaoyu [6 ]
Guo, Sicen [1 ,2 ,3 ,4 ]
Shao, Yuting [6 ]
Lv, Xiao [6 ]
Han, Wenting [6 ]
Christopher, Mark [7 ,8 ]
Zangwill, Linda M. [7 ,8 ]
Bi, Yanlong [6 ,9 ]
Fan, Rui [1 ,2 ,3 ,4 ]
机构
[1] Tongji Univ, Coll Elect & Informat Engn, Dept Control Sci & Engn, MIAS Grp, Shanghai 201804, Peoples R China
[2] Tongji Univ, Shanghai Inst Intelligent Sci & Technol, Shanghai 201804, Peoples R China
[3] Tongji Univ, Shanghai Res Inst Intelligent Autonomous Syst, State Key Lab Intelligent Autonomous Syst, Shanghai 201210, Peoples R China
[4] Tongji Univ, Frontiers Sci Ctr Intelligent Autonomous Syst, Shanghai 201210, Peoples R China
[5] Shanghai Univ, Sch Life Sci, 99 Shangda Ave, Shanghai 200444, Peoples R China
[6] Tongji Univ, Tongji Hosp, Sch Med, Dept Ophthalmol, Shanghai 200065, Peoples R China
[7] Univ Calif San Diego, Hamilton Glaucoma Ctr, La Jolla, CA 92037 USA
[8] Univ Calif San Diego, Shiley Eye Inst, Viterbi Family Dept Ophthalmol, Div Ophthalmol Informat & Data Sci, La Jolla, CA 92037 USA
[9] Tongji Univ, Tongji Eye Inst, Sch Med, Shanghai 200065, Peoples R China
基金
中国国家自然科学基金;
关键词
Optic nerve head; Fundus image; Semantic segmentation; Convolutional neural network; Transformer; FOVEA;
D O I
10.1016/j.inffus.2024.102533
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Optic nerve head (ONH) detection has been a crucial area of study in ophthalmology for years. However, the significant discrepancy between fundus image datasets, each generated using a single type of fundus camera, poses challenges to the generalizability of ONH detection approaches developed based on semantic segmentation networks. Despite the numerous recent advancements in general-purpose semantic segmentation methods using convolutional neural networks (CNNs) and Transformers, there is currently a lack of benchmarks for these state -of -the -art (SoTA) networks specifically trained for ONH detection. Therefore, in this article, we make contributions from three key aspects: network design, the publication of a dataset, and the establishment of a comprehensive benchmark. Our newly developed ONH detection network, referred to as ODFormer, is based upon the Swin Transformer architecture and incorporates two novel components: a multi-scale context aggregator and a lightweight bidirectional feature recalibrator. Our published large-scale dataset, known as TongjiU-DROD, provides multi -resolution fundus images for each participant, captured using two distinct types of cameras. Our established benchmark involves three datasets: DRIONS-DB, DRISHTI-GS1, and TongjiU-DROD, created by researchers from different countries and containing fundus images captured from participants of diverse races and ages. Extensive experimental results demonstrate that our proposed ODFormer outperforms other state -of -the -art (SoTA) networks in terms of performance and generalizability. Our dataset and source code are publicly available at https://mias.group/ODFormer.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Optic nerve head segmentation using fundus images and optical coherence tomography images for glaucoma detection
    Babu, T. R. Ganesh
    Devi, S. Shenbaga
    Venkatesh, R.
    BIOMEDICAL PAPERS-OLOMOUC, 2015, 159 (04): : 607 - 615
  • [2] Weakly supervised semantic segmentation for optic disc of fundus image
    Lu, Zheng
    Chen, Dali
    Xue, Dingyu
    Zhang, Shibo
    JOURNAL OF ELECTRONIC IMAGING, 2019, 28 (03)
  • [3] Automated Localization of Optic Nerve Head in a Fundus Image using Computer Vision Techniques
    Issac, Ashish
    Soorya, M.
    Dutta, Malay Kishore
    2017 INTERNATIONAL CONFERENCE ON EMERGING TRENDS IN COMPUTING AND COMMUNICATION TECHNOLOGIES (ICETCCT), 2017, : 72 - 77
  • [4] Detection of the Optic Nerve Head in Fundus Images of the Retina Using the Hough Transform for Circles
    Xiaolu Zhu
    Rangaraj M. Rangayyan
    Anna L. Ells
    Journal of Digital Imaging, 2010, 23 : 332 - 341
  • [5] Detection of the Optic Nerve Head in Fundus Images of the Retina Using the Hough Transform for Circles
    Zhu, Xiaolu
    Rangayyan, Rangaraj M.
    Ells, Anna L.
    JOURNAL OF DIGITAL IMAGING, 2010, 23 (03) : 332 - 341
  • [6] Angiogram, Fundus, and Oxygen Saturation Optic Nerve Head Image Fusion
    Cao, Hua
    Khoobehi, Bahram
    IMAGING, MANIPULATION, AND ANALYSIS OF BIOMOLECULES, CELLS, AND TISSUES VII, 2009, 7182
  • [7] Model-based Optic Nerve Head Segmentation on Retinal Fundus Images
    Yin, Fengshou
    Liu, Jiang
    Ong, Sim Heng
    Sun, Ying
    Wong, Damon W. K.
    Ngan Meng Tan
    Cheung, Carol
    Baskaran, Mani
    Aung, Tin
    Wong, Tien Yin
    2011 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2011, : 2626 - 2629
  • [8] Quantitative depth analysis of optic nerve head using stereo retinal fundus image pair
    Gifu University, Graduate School of Medicine, 1-1 Yanagido, Gifu, Gifu 501-1194, Japan
    不详
    不详
    不详
    不详
    不详
    J Biomed Opt, 2008, 6
  • [9] Quantitative depth analysis of optic nerve head using stereo retinal fundus image pair
    Nakagawa, Toshiaki
    Suzuki, Takayoshi
    Hayashi, Yoshinori
    Mizukusa, Yutaka
    Hatanaka, Yuji
    Ishida, Kyoko
    Hara, Takeshi
    Fujita, Hiroshi
    Yamamoto, Tetsuya
    JOURNAL OF BIOMEDICAL OPTICS, 2008, 13 (06)
  • [10] Quantitative depth analysis of optic nerve head using stereo retinal fundus image pair
    Gifu University, Graduate School of Medicine, 1-1 Yanagido, Gifu, Gifu 501-1194, Japan
    不详
    不详
    不详
    不详
    J Biomed Opt, 2008, 6