Unraveling the deep learning gearbox in optical coherence tomography image segmentation towards explainable artificial intelligence

被引:17
|
作者
Maloca, Peter M. [1 ,2 ,3 ,4 ]
Mueller, Philipp L. [4 ,5 ]
Lee, Aaron Y. [6 ,7 ,8 ]
Tufail, Adnan [4 ]
Balaskas, Konstantinos [4 ,9 ]
Niklaus, Stephanie [10 ]
Kaiser, Pascal [11 ]
Suter, Susanne [11 ,12 ]
Zarranz-Ventura, Javier [13 ]
Egan, Catherine [4 ]
Scholl, Hendrik P. N. [1 ,3 ]
Schnitzer, Tobias K. [10 ]
Singer, Thomas [10 ]
Hasler, Pascal W. [2 ,3 ]
Denk, Nora [3 ,10 ]
机构
[1] Inst Mol & Clin Ophthalmol Basel IOB, Basel, Switzerland
[2] Univ Hosp Basel, Dept Ophthalmol, OCTlab, Basel, Switzerland
[3] Univ Basel, Dept Ophthalmol, Basel, Switzerland
[4] Moorfields Eye Hosp NHS Fdn Trust, London, England
[5] Univ Bonn, Dept Ophthalmol, Bonn, Germany
[6] Puget Sound Vet Affairs, Dept Ophthalmol, Seattle, WA USA
[7] Univ Washington, eSci Inst, Seattle, WA 98195 USA
[8] Univ Washington, Dept Ophthalmol, Seattle, WA 98195 USA
[9] Moorfields Ophthalm Reading Ctr, London, England
[10] Roche, Innovat Ctr Basel, Pharmaceut Sci PS, Pharma Res & Early Dev pRED, Basel, Switzerland
[11] Supercomp Syst, Zurich, Switzerland
[12] Zurich Univ Appl Sci, Wadenswil, Switzerland
[13] Hosp Clin Barcelona, Inst Clin Oftalmol, Barcelona, Spain
关键词
DIABETIC-RETINOPATHY; NEURAL-NETWORKS; OCT; PERFORMANCE; ALGORITHM; IMPACT; GAME; GO;
D O I
10.1038/s42003-021-01697-y
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Machine learning has greatly facilitated the analysis of medical data, while the internal operations usually remain intransparent. To better comprehend these opaque procedures, a convolutional neural network for optical coherence tomography image segmentation was enhanced with a Traceable Relevance Explainability (T-REX) technique. The proposed application was based on three components: ground truth generation by multiple graders, calculation of Hamming distances among graders and the machine learning algorithm, as well as a smart data visualization ('neural recording'). An overall average variability of 1.75% between the human graders and the algorithm was found, slightly minor to 2.02% among human graders. The ambiguity in ground truth had noteworthy impact on machine learning results, which could be visualized. The convolutional neural network balanced between graders and allowed for modifiable predictions dependent on the compartment. Using the proposed T-REX setup, machine learning processes could be rendered more transparent and understandable, possibly leading to optimized applications. Maloca et al. implement convolutional neural network (CNN) to automatically segment OCT images obtained from cynomolgus monkeys. The results are compared to annotations generated by human graders. The ambiguity in ground truth had noteworthy impact on machine learning results, which could be visualized.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Unraveling the deep learning gearbox in optical coherence tomography image segmentation towards explainable artificial intelligence
    Peter M. Maloca
    Philipp L. Müller
    Aaron Y. Lee
    Adnan Tufail
    Konstantinos Balaskas
    Stephanie Niklaus
    Pascal Kaiser
    Susanne Suter
    Javier Zarranz-Ventura
    Catherine Egan
    Hendrik P. N. Scholl
    Tobias K. Schnitzer
    Thomas Singer
    Pascal W. Hasler
    Nora Denk
    Communications Biology, 4
  • [2] Unraveling the complexity of Optical Coherence Tomography image segmentation using machine and deep learning techniques: A review
    Nawaz, Mehmood
    Uvaliyev, Adilet
    Bibi, Khadija
    Wei, Hao
    Abaxi, Sai Mu Dalike
    Masood, Anum
    Shi, Peilun
    Ho, Ho-Pui
    Yuan, Wu
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2023, 108
  • [3] Validation of automated artificial intelligence segmentation of optical coherence tomography images
    Maloca, Peter M.
    Lee, Aaron Y.
    de Carvalho, Emanuel R.
    Okada, Mali
    Fasler, Katrin
    Leung, Irene
    Hormann, Beat
    Kaiser, Pascal
    Suter, Susanne
    Hasler, Pascal W.
    Zarranz-Ventura, Javier
    Egan, Catherine
    Heeren, Tjebo F. C.
    Balaskas, Konstantinos
    Tufail, Adnan
    Scholl, Hendrik P. N.
    PLOS ONE, 2019, 14 (08):
  • [4] Artificial Intelligence Segmentation Algorithm-Based Optical Coherence Tomography Image in Evaluation of Binocular Retinopathy
    Shen, Jiemei
    COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE, 2022, 2022
  • [5] Diagnosis of multiple sclerosis using optical coherence tomography supported by explainable artificial intelligence
    Dongil-Moreno, F. J.
    Ortiz, M.
    Pueyo, A.
    Boquete, L.
    Sanchez-Morla, E. M.
    Jimeno-Huete, D.
    Miguel, J. M.
    Barea, R.
    Vilades, E.
    Garcia-Martin, E.
    EYE, 2024, 38 (08) : 1502 - 1508
  • [6] Transfer learning for optical coherence tomography angiography image segmentation
    Ma, Rui
    Hao, Lili
    Tao, Yudong
    Mendoza, Ximena
    Khodeiry, Mohamed M.
    Liu, Yuan
    Shyu, Mei-Ling
    Lee, Richard K.
    INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2022, 63 (07)
  • [7] Human selection bias drives the linear nature of the more ground truth effect in explainable deep learning optical coherence tomography image segmentation
    Maloca, Peter M.
    Pfau, Maximilian
    Janeschitz-Kriegl, Lucas
    Reich, Michael
    Goerdt, Lukas
    Holz, Frank G.
    Mueller, Philipp L.
    Valmaggia, Philippe
    Fasler, Katrin
    Keane, Pearse A.
    Zarranz-Ventura, Javier
    Zweifel, Sandrine
    Wiesendanger, Jonas
    Kaiser, Pascal
    Enz, Tim J.
    Rothenbuehler, Simon P.
    Hasler, Pascal W.
    Juedes, Marlene
    Freichel, Christian
    Egan, Catherine
    Tufail, Adnan
    Scholl, Hendrik P. N.
    Denk, Nora
    JOURNAL OF BIOPHOTONICS, 2024, 17 (02)
  • [8] OPTICAL COHERENCE TOMOGRAPHY IMAGE SEGMENTATION
    Duan, Jinming
    Tench, Christopher
    Gottlob, Irene
    Proudlock, Frank
    Bai, Li
    2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, : 4278 - 4282
  • [9] Artificial Intelligence and Optical Coherence Tomography Imaging
    Kapoor, Rahul
    Whigham, Benjamin T.
    Al-Aswad, Lama A.
    ASIA-PACIFIC JOURNAL OF OPHTHALMOLOGY, 2019, 8 (02): : 187 - 194
  • [10] Deep Neovascularization Segmentation by Learning Graphical Connectivity in Optical Coherence Tomography
    Ding, Lin
    Ren, Shangjie
    Dong, Feng
    2024 IEEE INTERNATIONAL INSTRUMENTATION AND MEASUREMENT TECHNOLOGY CONFERENCE, I2MTC 2024, 2024,