Unraveling the deep learning gearbox in optical coherence tomography image segmentation towards explainable artificial intelligence

被引:17
|
作者
Maloca, Peter M. [1 ,2 ,3 ,4 ]
Mueller, Philipp L. [4 ,5 ]
Lee, Aaron Y. [6 ,7 ,8 ]
Tufail, Adnan [4 ]
Balaskas, Konstantinos [4 ,9 ]
Niklaus, Stephanie [10 ]
Kaiser, Pascal [11 ]
Suter, Susanne [11 ,12 ]
Zarranz-Ventura, Javier [13 ]
Egan, Catherine [4 ]
Scholl, Hendrik P. N. [1 ,3 ]
Schnitzer, Tobias K. [10 ]
Singer, Thomas [10 ]
Hasler, Pascal W. [2 ,3 ]
Denk, Nora [3 ,10 ]
机构
[1] Inst Mol & Clin Ophthalmol Basel IOB, Basel, Switzerland
[2] Univ Hosp Basel, Dept Ophthalmol, OCTlab, Basel, Switzerland
[3] Univ Basel, Dept Ophthalmol, Basel, Switzerland
[4] Moorfields Eye Hosp NHS Fdn Trust, London, England
[5] Univ Bonn, Dept Ophthalmol, Bonn, Germany
[6] Puget Sound Vet Affairs, Dept Ophthalmol, Seattle, WA USA
[7] Univ Washington, eSci Inst, Seattle, WA 98195 USA
[8] Univ Washington, Dept Ophthalmol, Seattle, WA 98195 USA
[9] Moorfields Ophthalm Reading Ctr, London, England
[10] Roche, Innovat Ctr Basel, Pharmaceut Sci PS, Pharma Res & Early Dev pRED, Basel, Switzerland
[11] Supercomp Syst, Zurich, Switzerland
[12] Zurich Univ Appl Sci, Wadenswil, Switzerland
[13] Hosp Clin Barcelona, Inst Clin Oftalmol, Barcelona, Spain
关键词
DIABETIC-RETINOPATHY; NEURAL-NETWORKS; OCT; PERFORMANCE; ALGORITHM; IMPACT; GAME; GO;
D O I
10.1038/s42003-021-01697-y
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Machine learning has greatly facilitated the analysis of medical data, while the internal operations usually remain intransparent. To better comprehend these opaque procedures, a convolutional neural network for optical coherence tomography image segmentation was enhanced with a Traceable Relevance Explainability (T-REX) technique. The proposed application was based on three components: ground truth generation by multiple graders, calculation of Hamming distances among graders and the machine learning algorithm, as well as a smart data visualization ('neural recording'). An overall average variability of 1.75% between the human graders and the algorithm was found, slightly minor to 2.02% among human graders. The ambiguity in ground truth had noteworthy impact on machine learning results, which could be visualized. The convolutional neural network balanced between graders and allowed for modifiable predictions dependent on the compartment. Using the proposed T-REX setup, machine learning processes could be rendered more transparent and understandable, possibly leading to optimized applications. Maloca et al. implement convolutional neural network (CNN) to automatically segment OCT images obtained from cynomolgus monkeys. The results are compared to annotations generated by human graders. The ambiguity in ground truth had noteworthy impact on machine learning results, which could be visualized.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Generation of Augmented Capillary Network Optical Coherence Tomography Image Data of Human Skin for Deep Learning and Capillary Segmentation
    Mekonnen, Bitewulign Kassa
    Hsieh, Tung-Han
    Tsai, Dian-Fu
    Liaw, Shien-Kuei
    Yang, Fu-Liang
    Huang, Sheng-Lung
    DIAGNOSTICS, 2021, 11 (04)
  • [32] A lightweight deep learning model for retinal optical coherence tomography image classification
    Mathews, Mili Rosline
    Anzar, Sharafudeen Thaha Mohammed
    INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2023, 33 (01) : 204 - 216
  • [33] Automated volumetric segmentation of retinal fluid on optical coherence tomography using deep learning
    Guo, Yukun
    Xiong, Honglian
    Hormel, Tristan
    Wang, Jie
    Hwang, Thomas
    Jia, Yali
    INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2019, 60 (11)
  • [34] Deep-learning based, automated segmentation of macular edema in optical coherence tomography
    Lee, Cecilia S.
    Tyring, Ariel J.
    Deruyter, Nicolaas P.
    Wu, Yue
    Rokem, Ariel
    Lee, Aaron Y.
    BIOMEDICAL OPTICS EXPRESS, 2017, 8 (07): : 3440 - 3448
  • [35] Deep Learning Based Method for Retinal Layer Segmentation In Optical Coherence Tomography Images
    Zadro, Ivana
    Loncaric, Sven
    Radmilovic, Marin
    Vatavuk, Zoran
    INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2019, 60 (11)
  • [36] Explainable artificial intelligence approach towards classifying educational android app reviews using deep learning
    Zahoor, Kanwal
    Bawany, Narmeen Zakaria
    INTERACTIVE LEARNING ENVIRONMENTS, 2024, 32 (09) : 5227 - 5252
  • [37] Artificial Intelligence (AI) and Retinal Optical Coherence Tomography (OCT)
    Dahrouj, Mohammad
    Miller, John B.
    SEMINARS IN OPHTHALMOLOGY, 2021, 36 (04) : 341 - 345
  • [38] Applications of Artificial Intelligence in Optical Coherence Tomography Angiography Imaging
    Schottenhamml, Julia
    Hohberger, Bettina
    Mardin, Christian Yahya
    KLINISCHE MONATSBLATTER FUR AUGENHEILKUNDE, 2022, 239 (12) : 1412 - 1426
  • [39] Optical Coherence Tomography Angiography, Artificial Intelligence, and the Missing Capillaries
    Kashani, Amir H. H.
    Liu, T. Y. Alvin
    Jones, Craig
    JAMA OPHTHALMOLOGY, 2023, 141 (07) : 649 - 650
  • [40] Aerial Image Classification in Post Flood Scenarios Using Robust Deep Learning and Explainable Artificial Intelligence
    Manaf, Abdul
    Mughal, Nimra
    Talpur, Kazim Raza
    Talpur, Bandeh Ali
    Mujtaba, Ghulam
    Talpur, Samar Raza
    IEEE ACCESS, 2025, 13 : 35973 - 35984