Deep Learning Predicts OCT Measures of Diabetic Macular Thickening From Color Fundus Photographs

PURPOSE. To develop deep learning (DL) models for the automatic detection of optical coherence tomography (OCT) measures of diabetic macular thickening (MT) from color fundus photographs (CFPs). METHODS. Retrospective analysis on 17,997 CFPs and their associated OCT measurements from the phase 3 RIDE/RISE diabetic macular edema (DME) studies. DL with transfer-learning cascade was applied on CFPs to predict time-domain OCT (TD-OCT)-equivalent measures of MT, including central subfield thickness (CST) and central foveal thickness (CFT). MT was defined by using two OCT cutoff points: 250 mu m and 400 mu m. A DL regression model was developed to directly quantify the actual CFT and CST from CFPs. RESULTS. The best DL model was able to predict CST >= 250 mu m and CFT >= 250 mu m with an area under the curve (AUC) of 0.97 (95% confidence interval [CI], 0.89-1.00) and 0.91 (95% CI, 0.76-0.99), respectively. To predict CST >= 400 mu m and CFT >= 400 mu m, the best DL model had an AUC of 0.94 (95% CI, 0.82-1.00) and 0.96 (95% CI, 0.88-1.00), respectively. The best deep convolutional neural network regression model to quantify CST and CFT had an R-2 of 0.74 (95% CI, 0.49-0.91) and 0.54 (95% CI, 0.20-0.87), respectively. The performance of the DL models declined when the CFPs were of poor quality or contained laser scars. CONCLUSIONS. DL is capable of predicting key quantitative TD-OCT measurements related to MT from CFPs. The DL models presented here could enhance the efficiency of DME diagnosis in tele-ophthalmology programs, promoting better visual outcomes. Future research is needed to validate DL algorithms for MT in the real-world.