ODFormer: Semantic fundus image segmentation using Transformer for optic nerve head detection

被引:0
|
作者
Wang, Jiayi [1 ,2 ,3 ,4 ]
Mao, Yi-An [5 ]
Ma, Xiaoyu [6 ]
Guo, Sicen [1 ,2 ,3 ,4 ]
Shao, Yuting [6 ]
Lv, Xiao [6 ]
Han, Wenting [6 ]
Christopher, Mark [7 ,8 ]
Zangwill, Linda M. [7 ,8 ]
Bi, Yanlong [6 ,9 ]
Fan, Rui [1 ,2 ,3 ,4 ]
机构
[1] Tongji Univ, Coll Elect & Informat Engn, Dept Control Sci & Engn, MIAS Grp, Shanghai 201804, Peoples R China
[2] Tongji Univ, Shanghai Inst Intelligent Sci & Technol, Shanghai 201804, Peoples R China
[3] Tongji Univ, Shanghai Res Inst Intelligent Autonomous Syst, State Key Lab Intelligent Autonomous Syst, Shanghai 201210, Peoples R China
[4] Tongji Univ, Frontiers Sci Ctr Intelligent Autonomous Syst, Shanghai 201210, Peoples R China
[5] Shanghai Univ, Sch Life Sci, 99 Shangda Ave, Shanghai 200444, Peoples R China
[6] Tongji Univ, Tongji Hosp, Sch Med, Dept Ophthalmol, Shanghai 200065, Peoples R China
[7] Univ Calif San Diego, Hamilton Glaucoma Ctr, La Jolla, CA 92037 USA
[8] Univ Calif San Diego, Shiley Eye Inst, Viterbi Family Dept Ophthalmol, Div Ophthalmol Informat & Data Sci, La Jolla, CA 92037 USA
[9] Tongji Univ, Tongji Eye Inst, Sch Med, Shanghai 200065, Peoples R China
基金
中国国家自然科学基金;
关键词
Optic nerve head; Fundus image; Semantic segmentation; Convolutional neural network; Transformer; FOVEA;
D O I
10.1016/j.inffus.2024.102533
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Optic nerve head (ONH) detection has been a crucial area of study in ophthalmology for years. However, the significant discrepancy between fundus image datasets, each generated using a single type of fundus camera, poses challenges to the generalizability of ONH detection approaches developed based on semantic segmentation networks. Despite the numerous recent advancements in general-purpose semantic segmentation methods using convolutional neural networks (CNNs) and Transformers, there is currently a lack of benchmarks for these state -of -the -art (SoTA) networks specifically trained for ONH detection. Therefore, in this article, we make contributions from three key aspects: network design, the publication of a dataset, and the establishment of a comprehensive benchmark. Our newly developed ONH detection network, referred to as ODFormer, is based upon the Swin Transformer architecture and incorporates two novel components: a multi-scale context aggregator and a lightweight bidirectional feature recalibrator. Our published large-scale dataset, known as TongjiU-DROD, provides multi -resolution fundus images for each participant, captured using two distinct types of cameras. Our established benchmark involves three datasets: DRIONS-DB, DRISHTI-GS1, and TongjiU-DROD, created by researchers from different countries and containing fundus images captured from participants of diverse races and ages. Extensive experimental results demonstrate that our proposed ODFormer outperforms other state -of -the -art (SoTA) networks in terms of performance and generalizability. Our dataset and source code are publicly available at https://mias.group/ODFormer.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] Localization Of The Optic Nerve Head In Color Fundus Images
    Malinsky, M.
    Kolar, R.
    Jan, J.
    ANALYSIS OF BIOMEDICAL SIGNALS AND IMAGES, 2008, : 593 - 599
  • [22] Location of the fovea at the fundus in relation to the optic nerve head
    Klaus Rohrschneider
    Roland Glück
    Friedrich E. Kruse
    Hans E. Völcker
    Der Ophthalmologe, 1998, 95 : 706 - 709
  • [23] Location of the fovea at the fundus in relation to the optic nerve head
    Rohrschneider, K
    Gluck, R
    Kruse, FE
    Volcker, HE
    OPHTHALMOLOGE, 1998, 95 (10): : 706 - 709
  • [24] Automated Microaneurysms Detection in Fundus Images Using Image Segmentation
    Sreng, Syna
    Maneerat, Noppadol
    Hamamoto, Kazuhiko
    2017 INTERNATIONAL CONFERENCE ON DIGITAL ARTS, MEDIA AND TECHNOLOGY (ICDAMT): DIGITAL ECONOMY FOR SUSTAINABLE GROWTH, 2017, : 19 - 23
  • [25] Effect of Two Different Preprocessing Steps in Detection of Optic Nerve Head in Fundus Images
    Tavakoli, Meysam
    Nazar, Mahdieh
    Mehdizadeh, Alireza
    MEDICAL IMAGING 2017: COMPUTER-AIDED DIAGNOSIS, 2017, 10134
  • [26] Comparison of Deep Learning Glaucoma Detection Using Optic Nerve Head Fundus Photos and Optical Coherence Tomography
    Christopher, Mark
    Bowd, Christopher
    Walker, Evan
    Belghith, Akram
    Goldbaum, Michael Henry
    Rezapour, Jasmin
    Fazio, Massimo A.
    Girkin, Christopher A.
    De Moraes, Gustavo
    Liebmann, Jeffrey M.
    Weinreb, Robert N.
    Grzybowski, Andrzej
    Zangwill, Linda
    INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2022, 63 (07)
  • [27] Modeling of the Pixel Based Segmentation to Detect Nerve Optic Head on the Retinal Image
    Muntasa, Arif
    Siradjuddin, Indah Agustien
    Sophan, Moch Kautsar
    2015 INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY SYSTEMS AND INNOVATION (ICITSI), 2015,
  • [28] Graph based Optic Nerve Head Segmentation
    Nie, Qing
    Fang, Leyuan
    Li, Huiqi
    Gao, Fei
    PROCEEDINGS OF THE 2014 9TH IEEE CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA), 2014, : 1010 - +
  • [29] Optic nerve head segmentation in HRT images
    Yang, Xiaoyun
    Morrow, Philip
    Scotney, Bryan
    2006 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP 2006, PROCEEDINGS, 2006, : 65 - +
  • [30] Automatic optic disc segmentation for analysis of the optic nerve head
    Chrastek, R
    Wolf, M
    Donath, K
    Michelson, G
    Niemann, H
    CARS 2001: COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2001, 1230 : 1119 - 1119