ODFormer: Semantic fundus image segmentation using Transformer for optic nerve head detection

被引:0
|
作者
Wang, Jiayi [1 ,2 ,3 ,4 ]
Mao, Yi-An [5 ]
Ma, Xiaoyu [6 ]
Guo, Sicen [1 ,2 ,3 ,4 ]
Shao, Yuting [6 ]
Lv, Xiao [6 ]
Han, Wenting [6 ]
Christopher, Mark [7 ,8 ]
Zangwill, Linda M. [7 ,8 ]
Bi, Yanlong [6 ,9 ]
Fan, Rui [1 ,2 ,3 ,4 ]
机构
[1] Tongji Univ, Coll Elect & Informat Engn, Dept Control Sci & Engn, MIAS Grp, Shanghai 201804, Peoples R China
[2] Tongji Univ, Shanghai Inst Intelligent Sci & Technol, Shanghai 201804, Peoples R China
[3] Tongji Univ, Shanghai Res Inst Intelligent Autonomous Syst, State Key Lab Intelligent Autonomous Syst, Shanghai 201210, Peoples R China
[4] Tongji Univ, Frontiers Sci Ctr Intelligent Autonomous Syst, Shanghai 201210, Peoples R China
[5] Shanghai Univ, Sch Life Sci, 99 Shangda Ave, Shanghai 200444, Peoples R China
[6] Tongji Univ, Tongji Hosp, Sch Med, Dept Ophthalmol, Shanghai 200065, Peoples R China
[7] Univ Calif San Diego, Hamilton Glaucoma Ctr, La Jolla, CA 92037 USA
[8] Univ Calif San Diego, Shiley Eye Inst, Viterbi Family Dept Ophthalmol, Div Ophthalmol Informat & Data Sci, La Jolla, CA 92037 USA
[9] Tongji Univ, Tongji Eye Inst, Sch Med, Shanghai 200065, Peoples R China
基金
中国国家自然科学基金;
关键词
Optic nerve head; Fundus image; Semantic segmentation; Convolutional neural network; Transformer; FOVEA;
D O I
10.1016/j.inffus.2024.102533
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Optic nerve head (ONH) detection has been a crucial area of study in ophthalmology for years. However, the significant discrepancy between fundus image datasets, each generated using a single type of fundus camera, poses challenges to the generalizability of ONH detection approaches developed based on semantic segmentation networks. Despite the numerous recent advancements in general-purpose semantic segmentation methods using convolutional neural networks (CNNs) and Transformers, there is currently a lack of benchmarks for these state -of -the -art (SoTA) networks specifically trained for ONH detection. Therefore, in this article, we make contributions from three key aspects: network design, the publication of a dataset, and the establishment of a comprehensive benchmark. Our newly developed ONH detection network, referred to as ODFormer, is based upon the Swin Transformer architecture and incorporates two novel components: a multi-scale context aggregator and a lightweight bidirectional feature recalibrator. Our published large-scale dataset, known as TongjiU-DROD, provides multi -resolution fundus images for each participant, captured using two distinct types of cameras. Our established benchmark involves three datasets: DRIONS-DB, DRISHTI-GS1, and TongjiU-DROD, created by researchers from different countries and containing fundus images captured from participants of diverse races and ages. Extensive experimental results demonstrate that our proposed ODFormer outperforms other state -of -the -art (SoTA) networks in terms of performance and generalizability. Our dataset and source code are publicly available at https://mias.group/ODFormer.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] Estimating 3D Topographic Map of Optic Nerve Head from a Single Fundus Image
    Wang, Peipei
    Sun, Jivai
    NINTH INTERNATIONAL CONFERENCE ON GRAPHIC AND IMAGE PROCESSING (ICGIP 2017), 2018, 10615
  • [42] Laformer: Vision Transformer for Panoramic Image Semantic Segmentation
    Yuan, Zheng
    Wang, Junhua
    Lv, Yuxin
    Wang, Ding
    Fang, Yi
    IEEE SIGNAL PROCESSING LETTERS, 2023, 30 : 1792 - 1796
  • [43] Detection Range Enhancement for Φ-OTDR Using Semantic Image Segmentation
    Li, Junchan
    Wang, Yu
    Wang, Pengfei
    Zhong, Jingbo
    Bai, Qing
    Jin, Baoquan
    JOURNAL OF LIGHTWAVE TECHNOLOGY, 2022, 40 (14) : 4886 - 4895
  • [44] Improving Underwater Obstacle Detection using Semantic Image Segmentation
    Arain, Bilal
    McCool, Chris
    Rigby, Paul
    Cagara, Daniel
    Dunbabin, Matthew
    2019 INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2019, : 9271 - 9277
  • [45] Semantic Image Segmentation for Pedestrian Detection
    Nurhadiyatna, Adi
    Loncaric, Sven
    PROCEEDINGS OF THE 10TH INTERNATIONAL SYMPOSIUM ON IMAGE AND SIGNAL PROCESSING AND ANALYSIS, 2017, : 153 - 158
  • [46] Head-Free Lightweight Semantic Segmentation with Linear Transformer
    Dong, Bo
    Wang, Pichao
    Wang, Fan
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 1, 2023, : 516 - 524
  • [47] Early detection of glaucoma using fully automated disparity analysis of optic nerve head (ONH) from stereo fundus images
    Sharma, Archie
    Corona, Enrique
    Mitra, Sunanda
    Nutter, Brian S.
    MEDICAL IMAGING 2006: IMAGE PROCESSING, PTS 1-3, 2006, 6144
  • [48] Automatic Optic Disc Detection in Digital Fundus Images Using Image Processing
    Akhade, Snehal B.
    Deshmukh, V. U.
    Deosarkar, S. B.
    2014 INTERNATIONAL CONFERENCE ON GREEN COMPUTING COMMUNICATION AND ELECTRICAL ENGINEERING (ICGCCEE), 2014,
  • [49] Cost-effective instrumentation for quantitative depth measurement of optic nerve head using stereo fundus image pair and image cross correlation techniques
    Vieira de Carvalho, Luis Alberto
    Carvalho, Valeria
    OPHTHALMIC TECHNOLOGIES XXIV, 2014, 8930
  • [50] Automated Detection of Optic Disc for the Analysis of Retina Using Color Fundus Image
    Zubair, Muhammad
    Yamin, Abubakar
    Khan, Shoab A.
    2013 IEEE INTERNATIONAL CONFERENCE ON IMAGING SYSTEMS AND TECHNIQUES (IST 2013), 2013, : 239 - 242